Jul 12 21:52:20.787354 ip-10-0-143-64 systemd[1]: Starting Kubernetes Kubelet...
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.173553    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181417    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181432    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181436    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181442    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181445    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181449    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181452    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:21.210403 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181455    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181458    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181461    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181463    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181466    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181469    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181473    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181475    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181481    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181484    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181490    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181493    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181496    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181499    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181501    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181504    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181507    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181510    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181512    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181516    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:21.211445 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181519    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181524    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181527    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181529    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181532    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181535    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181890    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181893    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181896    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181899    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181902    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181905    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181907    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181912    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181915    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181918    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181921    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181923    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181928    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181931    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:21.212036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181934    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181937    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181940    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181943    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181946    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181952    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181956    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181961    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181964    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181967    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181970    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181973    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181976    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181979    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181982    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181984    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181992    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.181996    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182001    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:21.212851 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182006    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182009    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182012    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182016    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182019    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182022    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182025    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182028    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182031    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182037    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182040    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182042    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182045    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182048    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182050    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182053    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182056    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182071    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182079    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:21.213477 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182082    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182084    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182087    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182092    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182095    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182098    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182102    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182105    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182107    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182110    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182113    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182116    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182119    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.182122    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183250    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183257    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183261    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183264    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183267    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183270    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:21.214079 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183276    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183278    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183281    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183284    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183287    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183290    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183293    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183295    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183298    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183301    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183303    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183306    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183308    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183314    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183317    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183319    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183322    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183325    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183328    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183331    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:21.214677 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183333    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183336    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183339    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183342    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183345    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183351    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183355    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183359    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183362    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183365    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183367    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183371    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183374    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183376    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183379    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183382    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183384    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183390    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:21.215510 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183394    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183397    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183400    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183403    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183406    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183409    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183411    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183414    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183417    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183420    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183423    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183426    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183431    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183433    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183436    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183439    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183441    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183444    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183447    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183450    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:21.216396 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183453    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183455    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183458    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183461    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183466    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183469    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183472    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183475    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183479    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183482    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183484    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183487    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183490    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183492    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183497    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183499    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183505    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183507    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183510    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183513    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:21.217341 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183516    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183518    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183521    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183523    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183526    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183529    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183532    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183536    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183542    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183545    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183548    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183551    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183554    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183557    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.183560    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184174    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184180    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184182    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184188    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:21.218012 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184191    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184194    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184197    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184200    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184203    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184207    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184211    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184216    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184219    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184222    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184225    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184231    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184234    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184237    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184239    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184242    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184245    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184248    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184250    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184253    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:21.218653 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184256    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184259    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184262    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184267    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184270    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184273    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184275    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184278    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184281    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184284    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184287    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184290    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184293    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184296    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184299    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184301    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184306    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184309    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184312    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184316    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:21.219687 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184318    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184321    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184324    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184327    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184330    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184332    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184336    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184340    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184346    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184348    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184351    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184354    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184356    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184359    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184361    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184364    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184367    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184370    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184372    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:21.220326 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184375    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184378    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184384    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184386    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184391    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184394    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184396    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184399    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184402    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184404    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184407    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184409    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184414    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184420    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184422    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184425    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184428    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184430    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184433    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184436    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:21.220969 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184439    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184442    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184445    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184448    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184450    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184453    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184458    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184461    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184465    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184469    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184472    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184475    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184478    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184481    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184484    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.184487    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184572    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184579    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184585    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184589    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184593    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 12 21:52:21.221832 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184603    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184611    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184615    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184620    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184623    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184626    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184632    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184635    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184639    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184644    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184647    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184651    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184654    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184658    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184661    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184664    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184668    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184673    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184677    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184680    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184683    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184687    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184690    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184693    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 12 21:52:21.224824 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184696    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184699    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184704    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184709    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184712    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184715    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184718    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184721    2581 flags.go:64] FLAG: --enable-server="true"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184725    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184729    2581 flags.go:64] FLAG: --event-burst="100"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184734    2581 flags.go:64] FLAG: --event-qps="50"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184739    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184742    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184745    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184751    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184754    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184762    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184765    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184771    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184774    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184777    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184780    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184783    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184786    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184789    2581 flags.go:64] FLAG: --feature-gates=""
Jul 12 21:52:21.225662 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184793    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184796    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184801    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184804    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184808    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184811    2581 flags.go:64] FLAG: --help="false"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184814    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-143-64.ec2.internal"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184817    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184820    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184823    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184829    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184833    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184836    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184839    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184842    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184845    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184848    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184851    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184856    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184861    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184865    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184869    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184872    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184876    2581 flags.go:64] FLAG: --lock-file=""
Jul 12 21:52:21.333049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184878    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 12 21:52:21.251886 ip-10-0-143-64 systemd[1]: Started Kubernetes Kubelet.
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184882    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184885    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184892    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184895    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184898    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184901    2581 flags.go:64] FLAG: --logging-format="text"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184905    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184908    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184911    2581 flags.go:64] FLAG: --manifest-url=""
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184914    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184919    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184924    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184928    2581 flags.go:64] FLAG: --max-pods="110"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184931    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184934    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184938    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184941    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184944    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184947    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184952    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184959    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184962    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184966    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 12 21:52:21.333934 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184969    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184972    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184978    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184985    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184988    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184992    2581 flags.go:64] FLAG: --port="10250"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184995    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.184998    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0807881fbb54f024b"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185002    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185005    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185008    2581 flags.go:64] FLAG: --register-node="true"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185011    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185017    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185020    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185023    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185026    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185030    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185033    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185036    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185039    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185045    2581 flags.go:64] FLAG: --runonce="false"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185048    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185051    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185054    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185071    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 12 21:52:21.334790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185075    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185078    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185081    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185085    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185090    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185093    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185097    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185100    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185103    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185106    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185110    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185119    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185126    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185129    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185133    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185136    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185139    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185142    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185145    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185151    2581 flags.go:64] FLAG: --v="2"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185155    2581 flags.go:64] FLAG: --version="false"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185159    2581 flags.go:64] FLAG: --vmodule=""
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185163    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.185166    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185364    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:21.335713 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185368    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185371    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185374    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185377    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185379    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185386    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185392    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185395    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185398    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185400    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185403    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185406    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185410    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185412    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185415    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185418    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185421    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185426    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185433    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:21.336464 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185437    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185440    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185442    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185445    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185447    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185450    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185453    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185456    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185458    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185461    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185464    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185466    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185471    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185474    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185476    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185479    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185481    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185484    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185487    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185489    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:21.337087 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185492    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185494    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185497    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185500    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185506    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185510    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185513    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185516    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185520    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185523    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185527    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185530    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185535    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185538    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185545    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185548    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185551    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185557    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185560    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185578    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:21.337666 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185581    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185705    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185709    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185711    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185714    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185717    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185719    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185722    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185725    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185727    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185730    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185732    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185735    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185737    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185740    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185743    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185745    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185748    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185750    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185757    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:21.338299 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185760    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185763    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185767    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185769    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185773    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185776    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185778    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185781    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185785    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185789    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185791    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185794    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185797    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185800    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185803    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185805    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185809    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185811    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:21.338855 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.185814    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.186332    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.193259    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.193280    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.193997    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.194007    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194098    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194105    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194110    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194114    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194117    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194121    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194126    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194130    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194134    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:21.339595 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194138    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194142    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194145    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194150    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194154    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194158    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194162    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194166    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194170    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194174    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194177    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194181    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194184    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194189    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194193    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194196    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194200    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194203    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194207    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194211    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:21.340487 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194215    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194220    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194223    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194227    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194233    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194238    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194243    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194246    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194251    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194255    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194259    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194263    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194267    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194271    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194276    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194283    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194286    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194290    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194294    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:21.341103 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194299    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194303    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194306    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194310    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194314    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194318    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194324    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194327    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194331    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194335    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194339    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194342    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194346    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194350    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194354    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194358    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194361    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194365    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194369    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194373    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:21.341718 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194376    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194380    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194384    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194387    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194391    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194394    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194398    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194402    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194406    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194411    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194414    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194418    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194422    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194427    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194433    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194438    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194443    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194447    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194453    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:21.342511 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194457    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194461    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194466    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194472    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194476    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194480    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194484    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194487    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194491    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194495    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194498    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194502    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.194509    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194655    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194661    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 12 21:52:21.343332 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194665    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194669    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194673    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194677    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194681    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194685    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194690    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194694    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194698    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194702    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194706    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194709    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194714    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194718    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194724    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194729    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194733    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194739    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194744    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 12 21:52:21.343951 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194750    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194755    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194759    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194763    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194767    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194771    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194774    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194778    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194782    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194787    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194790    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194794    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194798    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194802    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194805    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194809    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194813    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194817    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194820    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 12 21:52:21.344578 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194826    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194830    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194834    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194838    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194842    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194845    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194850    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194854    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194858    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194862    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194865    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194872    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194876    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194880    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194884    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194888    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194892    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194896    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194899    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 12 21:52:21.345186 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194903    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194907    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194910    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194914    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194918    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194922    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194925    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194929    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194933    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194937    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194941    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194945    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194948    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194954    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194958    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194962    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194965    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194969    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194973    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194976    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 12 21:52:21.345680 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194981    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194985    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194988    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194992    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.194997    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195001    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195005    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195008    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195012    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195016    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195020    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195024    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195028    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195032    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195035    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195039    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195043    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195047    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195051    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 12 21:52:21.346241 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:21.195076    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.195084    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.195209    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.197523    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.199025    2581 server.go:1019] "Starting client certificate rotation"
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.199126    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.199162    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.201505    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.203446    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.216248    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.218765    2581 log.go:25] "Validated CRI v1 image API"
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.219647    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 12 21:52:21.347241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.222593    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a3ddfacc-2488-4998-8af0-be1ebd5fa9eb:/dev/nvme0n1p4 bb595fc0-cf60-4f82-bd9c-9176310ff5a9:/dev/nvme0n1p3]
Jul 12 21:52:21.347615 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.222610    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 12 21:52:21.347615 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.234578    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.235194    2581 manager.go:216] Machine: {Timestamp:2026-07-12 21:52:21.234143394 +0000 UTC m=+0.331466671 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093437 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e5a0d6b147ebffbdd927765484e0f SystemUUID:ec2e5a0d-6b14-7ebf-fbdd-927765484e0f BootID:b49568d1-15f0-4e04-8c82-6f7dc99a905b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f9:fa:86:a0:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f9:fa:86:a0:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:b5:70:71:f6:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.235293    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.235365    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.236474    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.236496    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.237235    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.237246    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.237253    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.238382    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.239641    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.242450    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.242557    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.242585    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.242594    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.242605    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.242613    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.242623    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 12 21:52:22.718745 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.242962    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.242981    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.244848    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.246834    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.246862    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247000    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247011    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247017    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247022    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247030    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247036    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247467    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247474    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247481    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247493    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247506    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.247514    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.248176    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.248183    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.251197    2581 server.go:1268] "Started kubelet"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.251253    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.251422    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.251476    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.252653    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.254654    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.254867    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ngtz2"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.255024    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.255113    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.255310    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.255310    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-64.ec2.internal.18c1a95c49881b15  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-64.ec2.internal,UID:ip-10-0-143-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-64.ec2.internal,},FirstTimestamp:2026-07-12 21:52:21.251169045 +0000 UTC m=+0.348492301,LastTimestamp:2026-07-12 21:52:21.251169045 +0000 UTC m=+0.348492301,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-64.ec2.internal,}"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.256677    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.258434    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.258735    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.260402    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.260985    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.260993    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.261142    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.261196    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.261200    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.262349    2581 factory.go:55] Registering systemd factory
Jul 12 21:52:22.719997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.262365    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.262647    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ngtz2"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.262653    2581 factory.go:153] Registering CRI-O factory
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.262679    2581 factory.go:223] Registration of the crio container factory successfully
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.262725    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.262749    2581 factory.go:103] Registering Raw factory
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.262766    2581 manager.go:1196] Started watching for new ooms in manager
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.263088    2581 manager.go:349] Starting recovery of all containers
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.263739    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.263845    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.272612    2581 manager.go:354] Recovery completed
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.276666    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.278520    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.278544    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.278557    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.279041    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.279072    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.279090    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.279045    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.280099    2581 policy_none.go:49] "None policy: Start"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.280112    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.280122    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.281108    2581 policy_none.go:47] "Start"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.281636    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.281658    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.281668    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.319641    2581 manager.go:337] "Starting Device Plugin manager"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.319672    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.319681    2581 server.go:87] "Starting device plugin registration server"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.319901    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.319912    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.319994    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.320094    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.320104    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.320506    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.320554    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.420246    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.421103    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.421132    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.421142    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.421167    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-64.ec2.internal"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.427989    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.429136    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.429181    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.429203    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.429241    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.431693    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 21:52:22.721734 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:21.433410    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-64.ec2.internal"
Jul 12 21:52:22.723727 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:21.433427    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-64.ec2.internal\": node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:22.727566    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.763678    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal"]
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.763777    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.764626    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.764651    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.764660    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.765939    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.766072    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.766098    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.768345    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.768348    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.768368    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.768370    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.768378    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.768382    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.769479    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.769504    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.770084    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientMemory"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.770104    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasNoDiskPressure"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.770113    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeHasSufficientPID"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:22.792220    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-64.ec2.internal\" not found" node="ip-10-0-143-64.ec2.internal"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:22.802315    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-64.ec2.internal\" not found" node="ip-10-0-143-64.ec2.internal"
Jul 12 21:52:22.842622 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:22.827886    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:22.998503 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.899631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7615c3a8f34a3b249ea13dab5c9e3cbb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"7615c3a8f34a3b249ea13dab5c9e3cbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:22.998503 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.899655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7615c3a8f34a3b249ea13dab5c9e3cbb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"7615c3a8f34a3b249ea13dab5c9e3cbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:22.998503 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:22.899672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59a0a931653a6c997ccb77f8eb321696-config\") pod \"kube-apiserver-proxy-ip-10-0-143-64.ec2.internal\" (UID: \"59a0a931653a6c997ccb77f8eb321696\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:22.998503 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:22.928485    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:23.005547 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.000757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59a0a931653a6c997ccb77f8eb321696-config\") pod \"kube-apiserver-proxy-ip-10-0-143-64.ec2.internal\" (UID: \"59a0a931653a6c997ccb77f8eb321696\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:23.005547 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.000723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59a0a931653a6c997ccb77f8eb321696-config\") pod \"kube-apiserver-proxy-ip-10-0-143-64.ec2.internal\" (UID: \"59a0a931653a6c997ccb77f8eb321696\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:23.005547 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.000819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7615c3a8f34a3b249ea13dab5c9e3cbb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"7615c3a8f34a3b249ea13dab5c9e3cbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:23.005547 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.000836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7615c3a8f34a3b249ea13dab5c9e3cbb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"7615c3a8f34a3b249ea13dab5c9e3cbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:23.005547 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.000868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7615c3a8f34a3b249ea13dab5c9e3cbb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"7615c3a8f34a3b249ea13dab5c9e3cbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:23.005547 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.000904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7615c3a8f34a3b249ea13dab5c9e3cbb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal\" (UID: \"7615c3a8f34a3b249ea13dab5c9e3cbb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:23.112716 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:23.028816    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:23.112716 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.094020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:23.112716 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.104886    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:23.217595 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:23.129357    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:23.230197 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:23.229784    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:23.340747 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:23.330296    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:23.484432 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:23.430746    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:23.484432 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.431822    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 12 21:52:23.484432 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.431949    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 12 21:52:23.615532 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.501370    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 21:47:22 +0000 UTC" deadline="2028-01-02 10:33:49.641511395 +0000 UTC"
Jul 12 21:52:23.615532 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.501396    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12924h41m26.140120195s"
Jul 12 21:52:23.615532 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:23.531680    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:23.754384 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:23.632367    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:23.754384 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.661596    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 21:52:23.754384 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:23.665922    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a0a931653a6c997ccb77f8eb321696.slice/crio-87a0aa7b1587cf65f7707a4f66a4a21708bdb79b2b0146df3655f69dc2cacd2b WatchSource:0}: Error finding container 87a0aa7b1587cf65f7707a4f66a4a21708bdb79b2b0146df3655f69dc2cacd2b: Status 404 returned error can't find the container with id 87a0aa7b1587cf65f7707a4f66a4a21708bdb79b2b0146df3655f69dc2cacd2b
Jul 12 21:52:23.754384 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:23.666238    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7615c3a8f34a3b249ea13dab5c9e3cbb.slice/crio-32f11d63e9c8abdcd4869c08d448c0b9f28b2806f0b833b741d01897a9903d45 WatchSource:0}: Error finding container 32f11d63e9c8abdcd4869c08d448c0b9f28b2806f0b833b741d01897a9903d45: Status 404 returned error can't find the container with id 32f11d63e9c8abdcd4869c08d448c0b9f28b2806f0b833b741d01897a9903d45
Jul 12 21:52:23.754384 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:23.670276    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 21:52:23.754384 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:23.732607    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:23.900176 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:23.833065    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:24.022846 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:23.933597    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-64.ec2.internal\" not found"
Jul 12 21:52:24.022846 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.002140    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 21:52:24.022846 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.010305    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 21:52:24.098036 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.096209    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:24.171240 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.109249    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 21:52:24.171240 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.110314    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal"
Jul 12 21:52:24.171240 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.121556    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 12 21:52:24.477503 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.477377    2581 apiserver.go:52] "Watching apiserver"
Jul 12 21:52:24.492624 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.492595    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 12 21:52:24.493806 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.493767    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-q4z7k","kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t","openshift-cluster-node-tuning-operator/tuned-tgb55","openshift-network-diagnostics/network-check-target-n9pdg","openshift-network-operator/iptables-alerter-8jq2w","openshift-ovn-kubernetes/ovnkube-node-zwgn8","kube-system/global-pull-secret-syncer-9z5k9","kube-system/konnectivity-agent-dnzkt","openshift-dns/node-resolver-f5c5g","openshift-image-registry/node-ca-ns7fs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal","openshift-multus/multus-additional-cni-plugins-mc2jt","openshift-multus/multus-b6ktm"]
Jul 12 21:52:24.495005 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.494982    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 12 21:52:24.495422 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.495400    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 12 21:52:24.495568 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.495548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.496846 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.496824    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.498589 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.498440    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.498832 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.498812    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 12 21:52:24.498926 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.498870    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 12 21:52:24.499077 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.499060    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sr22x\""
Jul 12 21:52:24.499327 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.499307    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 12 21:52:24.499465 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.498812    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 12 21:52:24.499465 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.499437    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 12 21:52:24.499692 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.499660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.500063 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.500029    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 12 21:52:24.500815 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.500357    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 12 21:52:24.500815 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.500410    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6s24r\""
Jul 12 21:52:24.500815 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.500411    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 12 21:52:24.500815 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.500600    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 12 21:52:24.500815 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.500663    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 12 21:52:24.501365 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.501209    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 12 21:52:24.501365 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.501323    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 12 21:52:24.501806 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.501789    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:24.502133 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:24.501860    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:24.502133 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.501965    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 12 21:52:24.502133 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.502089    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k86zj\""
Jul 12 21:52:24.502133 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.502091    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 12 21:52:24.502391 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.502353    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:52:24.502910 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.502690    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mkmcn\""
Jul 12 21:52:24.502910 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.502861    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 12 21:52:24.503039 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.503021    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8jq2w"
Jul 12 21:52:24.504646 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.504562    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:24.505671 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.505527    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:52:24.505671 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.505555    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 12 21:52:24.505671 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.505584    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mpl42\""
Jul 12 21:52:24.505671 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.505641    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 12 21:52:24.506280 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.506263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:24.506378 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:24.506338    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.508215    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.508767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-run-ovn-kubernetes\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.508799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.508837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/521ee44d-7557-4a46-90be-5574d731b913-ovnkube-config\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.508870    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/521ee44d-7557-4a46-90be-5574d731b913-env-overrides\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.508905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-kubelet\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.508936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-slash\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.508992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-run-systemd\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-log-socket\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/521ee44d-7557-4a46-90be-5574d731b913-ovn-node-metrics-cert\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-systemd-units\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-etc-openvswitch\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509799 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-run-openvswitch\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509799 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509288    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-run-ovn\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509799 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-cni-bin\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509799 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/521ee44d-7557-4a46-90be-5574d731b913-ovnkube-script-lib\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509799 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-run-netns\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509799 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-var-lib-openvswitch\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509799 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-node-log\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509799 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-cni-netd\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.509799 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.509504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8sqg\" (UniqueName: \"kubernetes.io/projected/521ee44d-7557-4a46-90be-5574d731b913-kube-api-access-q8sqg\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.510862 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.510824    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f5c5g"
Jul 12 21:52:24.511427 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.511088    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 12 21:52:24.511427 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.511200    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 12 21:52:24.511427 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.511220    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 12 21:52:24.511606 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.511459    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rdttt\""
Jul 12 21:52:24.513020 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.512958    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ns7fs"
Jul 12 21:52:24.513682 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.513652    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 12 21:52:24.514224 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.514072    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 12 21:52:24.514224 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.514165    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g2l6g\""
Jul 12 21:52:24.514224 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.514204    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lqkb9\""
Jul 12 21:52:24.514467 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.514077    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 12 21:52:24.515249 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.515232    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:24.515360 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:24.515295    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:24.515472 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.515456    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 12 21:52:24.515533 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.515505    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 12 21:52:24.515687 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.515665    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 12 21:52:24.515795 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.515735    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2bz6m\""
Jul 12 21:52:24.534722 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.534685    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j26vg"
Jul 12 21:52:24.542236 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.542213    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j26vg"
Jul 12 21:52:24.596465 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.596443    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 12 21:52:24.609820 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.609796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-systemd-units\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.609941 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.609829    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-run-openvswitch\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.609941 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.609857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08852625-0839-4870-9c4d-ca1810b955c4-multus-daemon-config\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.609941 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.609875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-systemd-units\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.609941 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.609880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-system-cni-dir\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.609941 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.609932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-kubernetes\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.610157 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.609941    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-run-openvswitch\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.610157 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.609981    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-var-lib-kubelet\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.610157 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf464\" (UniqueName: \"kubernetes.io/projected/6d4a3f48-6604-492c-aa9a-a67a90d378d3-kube-api-access-qf464\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:24.610157 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610045    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48hdb\" (UniqueName: \"kubernetes.io/projected/08852625-0839-4870-9c4d-ca1810b955c4-kube-api-access-48hdb\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.610157 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-sys-fs\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.610157 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-run-ovn-kubernetes\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.610157 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mzvj\" (UniqueName: \"kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj\") pod \"network-check-target-n9pdg\" (UID: \"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7\") " pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:24.610157 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-var-lib-cni-bin\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.610426 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/738517e4-4a05-4309-85d5-a64743841ce0-iptables-alerter-script\") pod \"iptables-alerter-8jq2w\" (UID: \"738517e4-4a05-4309-85d5-a64743841ce0\") " pod="openshift-network-operator/iptables-alerter-8jq2w"
Jul 12 21:52:24.610426 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-kubelet\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.610426 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-run-ovn-kubernetes\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.610426 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-run-netns\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.610426 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610290    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-kubelet\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.610426 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-var-lib-kubelet\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.610426 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c5451bb-36cd-45ae-ae95-e7f841df4914-dbus\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:24.610679 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.610679 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610457    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-modprobe-d\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.610679 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/738517e4-4a05-4309-85d5-a64743841ce0-host-slash\") pod \"iptables-alerter-8jq2w\" (UID: \"738517e4-4a05-4309-85d5-a64743841ce0\") " pod="openshift-network-operator/iptables-alerter-8jq2w"
Jul 12 21:52:24.610679 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.610679 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-cni-bin\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.610679 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-etc-kubernetes\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.610679 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-cni-bin\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.610679 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610637    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drfh2\" (UniqueName: \"kubernetes.io/projected/48883128-e79b-4469-8bcf-92d3adbdbb1c-kube-api-access-drfh2\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.610679 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7769fe0a-f440-4ac6-866c-8c379f4cf6f6-agent-certs\") pod \"konnectivity-agent-dnzkt\" (UID: \"7769fe0a-f440-4ac6-866c-8c379f4cf6f6\") " pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610709    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ccdf2e0-1700-429b-8198-0861386af90b-serviceca\") pod \"node-ca-ns7fs\" (UID: \"2ccdf2e0-1700-429b-8198-0861386af90b\") " pod="openshift-image-registry/node-ca-ns7fs"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-run-netns\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610769    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610796    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-run-netns\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/521ee44d-7557-4a46-90be-5574d731b913-env-overrides\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-run-k8s-cni-cncf-io\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-run-multus-certs\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e22ccf9-a301-4b5a-af20-621e9027b3be-tmp-dir\") pod \"node-resolver-f5c5g\" (UID: \"9e22ccf9-a301-4b5a-af20-621e9027b3be\") " pod="openshift-dns/node-resolver-f5c5g"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-run\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610912    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.611012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.610989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611032    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbfpm\" (UniqueName: \"kubernetes.io/projected/05b952ef-2750-4877-b7aa-c9e7d5250058-kube-api-access-jbfpm\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-etc-openvswitch\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/521ee44d-7557-4a46-90be-5574d731b913-ovnkube-script-lib\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-multus-socket-dir-parent\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611135    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-etc-openvswitch\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611223    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-sysconfig\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-sysctl-conf\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-systemd\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-device-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-system-cni-dir\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611360    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-hostroot\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-multus-conf-dir\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611468    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/521ee44d-7557-4a46-90be-5574d731b913-env-overrides\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txvg8\" (UniqueName: \"kubernetes.io/projected/738517e4-4a05-4309-85d5-a64743841ce0-kube-api-access-txvg8\") pod \"iptables-alerter-8jq2w\" (UID: \"738517e4-4a05-4309-85d5-a64743841ce0\") " pod="openshift-network-operator/iptables-alerter-8jq2w"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611513    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08852625-0839-4870-9c4d-ca1810b955c4-cni-binary-copy\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.611553 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48883128-e79b-4469-8bcf-92d3adbdbb1c-tmp\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611560    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksw5h\" (UniqueName: \"kubernetes.io/projected/2ccdf2e0-1700-429b-8198-0861386af90b-kube-api-access-ksw5h\") pod \"node-ca-ns7fs\" (UID: \"2ccdf2e0-1700-429b-8198-0861386af90b\") " pod="openshift-image-registry/node-ca-ns7fs"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-os-release\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-var-lib-cni-multus\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e22ccf9-a301-4b5a-af20-621e9027b3be-hosts-file\") pod \"node-resolver-f5c5g\" (UID: \"9e22ccf9-a301-4b5a-af20-621e9027b3be\") " pod="openshift-dns/node-resolver-f5c5g"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-registration-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611684    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/521ee44d-7557-4a46-90be-5574d731b913-ovnkube-script-lib\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-run-ovn\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-cnibin\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c5451bb-36cd-45ae-ae95-e7f841df4914-kubelet-config\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-run-ovn\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-lib-modules\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-tuned\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-var-lib-openvswitch\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-node-log\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-var-lib-openvswitch\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-cni-netd\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.612302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.611990    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-node-log\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8sqg\" (UniqueName: \"kubernetes.io/projected/521ee44d-7557-4a46-90be-5574d731b913-kube-api-access-q8sqg\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-os-release\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-cni-netd\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f44pv\" (UniqueName: \"kubernetes.io/projected/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-kube-api-access-f44pv\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-sysctl-d\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-host\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-cnibin\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/521ee44d-7557-4a46-90be-5574d731b913-ovnkube-config\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7769fe0a-f440-4ac6-866c-8c379f4cf6f6-konnectivity-ca\") pod \"konnectivity-agent-dnzkt\" (UID: \"7769fe0a-f440-4ac6-866c-8c379f4cf6f6\") " pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ccdf2e0-1700-429b-8198-0861386af90b-host\") pod \"node-ca-ns7fs\" (UID: \"2ccdf2e0-1700-429b-8198-0861386af90b\") " pod="openshift-image-registry/node-ca-ns7fs"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-socket-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-slash\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612625    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-run-systemd\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612663    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-log-socket\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612676    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-host-slash\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613617 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/521ee44d-7557-4a46-90be-5574d731b913-ovn-node-metrics-cert\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613617 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-multus-cni-dir\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.613617 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612746    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-run-systemd\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613617 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612763    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/521ee44d-7557-4a46-90be-5574d731b913-log-socket\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613617 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxx84\" (UniqueName: \"kubernetes.io/projected/9e22ccf9-a301-4b5a-af20-621e9027b3be-kube-api-access-xxx84\") pod \"node-resolver-f5c5g\" (UID: \"9e22ccf9-a301-4b5a-af20-621e9027b3be\") " pod="openshift-dns/node-resolver-f5c5g"
Jul 12 21:52:24.613617 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612828    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-sys\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.613617 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.612833    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/521ee44d-7557-4a46-90be-5574d731b913-ovnkube-config\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.613617 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.613065    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 12 21:52:24.616398 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.616381    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/521ee44d-7557-4a46-90be-5574d731b913-ovn-node-metrics-cert\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.620390 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.620371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8sqg\" (UniqueName: \"kubernetes.io/projected/521ee44d-7557-4a46-90be-5574d731b913-kube-api-access-q8sqg\") pod \"ovnkube-node-zwgn8\" (UID: \"521ee44d-7557-4a46-90be-5574d731b913\") " pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.669357 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.669280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" event={"ID":"7615c3a8f34a3b249ea13dab5c9e3cbb","Type":"ContainerStarted","Data":"32f11d63e9c8abdcd4869c08d448c0b9f28b2806f0b833b741d01897a9903d45"}
Jul 12 21:52:24.670351 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.670323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" event={"ID":"59a0a931653a6c997ccb77f8eb321696","Type":"ContainerStarted","Data":"87a0aa7b1587cf65f7707a4f66a4a21708bdb79b2b0146df3655f69dc2cacd2b"}
Jul 12 21:52:24.713247 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-os-release\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.713247 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f44pv\" (UniqueName: \"kubernetes.io/projected/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-kube-api-access-f44pv\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.713449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713266    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-sysctl-d\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.713449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-host\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.713449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-cnibin\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.713449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.713449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:24.713449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7769fe0a-f440-4ac6-866c-8c379f4cf6f6-konnectivity-ca\") pod \"konnectivity-agent-dnzkt\" (UID: \"7769fe0a-f440-4ac6-866c-8c379f4cf6f6\") " pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:24.713449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-host\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.713449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ccdf2e0-1700-429b-8198-0861386af90b-host\") pod \"node-ca-ns7fs\" (UID: \"2ccdf2e0-1700-429b-8198-0861386af90b\") " pod="openshift-image-registry/node-ca-ns7fs"
Jul 12 21:52:24.713449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713395    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-os-release\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.713449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-socket-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-multus-cni-dir\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxx84\" (UniqueName: \"kubernetes.io/projected/9e22ccf9-a301-4b5a-af20-621e9027b3be-kube-api-access-xxx84\") pod \"node-resolver-f5c5g\" (UID: \"9e22ccf9-a301-4b5a-af20-621e9027b3be\") " pod="openshift-dns/node-resolver-f5c5g"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:24.713494    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-sys\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08852625-0839-4870-9c4d-ca1810b955c4-multus-daemon-config\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713539    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-socket-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713546    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-sysctl-d\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-system-cni-dir\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713492    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-cnibin\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:24.713580    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs podName:6d4a3f48-6604-492c-aa9a-a67a90d378d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:25.213558672 +0000 UTC m=+3.077245180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs") pod "network-metrics-daemon-q4z7k" (UID: "6d4a3f48-6604-492c-aa9a-a67a90d378d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713615    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ccdf2e0-1700-429b-8198-0861386af90b-host\") pod \"node-ca-ns7fs\" (UID: \"2ccdf2e0-1700-429b-8198-0861386af90b\") " pod="openshift-image-registry/node-ca-ns7fs"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713649    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-system-cni-dir\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-kubernetes\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-var-lib-kubelet\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713714    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-sys\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf464\" (UniqueName: \"kubernetes.io/projected/6d4a3f48-6604-492c-aa9a-a67a90d378d3-kube-api-access-qf464\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:24.713924 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48hdb\" (UniqueName: \"kubernetes.io/projected/08852625-0839-4870-9c4d-ca1810b955c4-kube-api-access-48hdb\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-sys-fs\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713782    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-multus-cni-dir\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713811    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-kubernetes\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzvj\" (UniqueName: \"kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj\") pod \"network-check-target-n9pdg\" (UID: \"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7\") " pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713843    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-sys-fs\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-var-lib-cni-bin\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/738517e4-4a05-4309-85d5-a64743841ce0-iptables-alerter-script\") pod \"iptables-alerter-8jq2w\" (UID: \"738517e4-4a05-4309-85d5-a64743841ce0\") " pod="openshift-network-operator/iptables-alerter-8jq2w"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713892    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-var-lib-kubelet\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-run-netns\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-run-netns\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7769fe0a-f440-4ac6-866c-8c379f4cf6f6-konnectivity-ca\") pod \"konnectivity-agent-dnzkt\" (UID: \"7769fe0a-f440-4ac6-866c-8c379f4cf6f6\") " pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.713996    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-var-lib-cni-bin\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-var-lib-kubelet\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c5451bb-36cd-45ae-ae95-e7f841df4914-dbus\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.714743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-var-lib-kubelet\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-modprobe-d\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c5451bb-36cd-45ae-ae95-e7f841df4914-dbus\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/738517e4-4a05-4309-85d5-a64743841ce0-host-slash\") pod \"iptables-alerter-8jq2w\" (UID: \"738517e4-4a05-4309-85d5-a64743841ce0\") " pod="openshift-network-operator/iptables-alerter-8jq2w"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714275    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-etc-kubernetes\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714293    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-modprobe-d\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drfh2\" (UniqueName: \"kubernetes.io/projected/48883128-e79b-4469-8bcf-92d3adbdbb1c-kube-api-access-drfh2\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7769fe0a-f440-4ac6-866c-8c379f4cf6f6-agent-certs\") pod \"konnectivity-agent-dnzkt\" (UID: \"7769fe0a-f440-4ac6-866c-8c379f4cf6f6\") " pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714353    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ccdf2e0-1700-429b-8198-0861386af90b-serviceca\") pod \"node-ca-ns7fs\" (UID: \"2ccdf2e0-1700-429b-8198-0861386af90b\") " pod="openshift-image-registry/node-ca-ns7fs"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-etc-selinux\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/738517e4-4a05-4309-85d5-a64743841ce0-host-slash\") pod \"iptables-alerter-8jq2w\" (UID: \"738517e4-4a05-4309-85d5-a64743841ce0\") " pod="openshift-network-operator/iptables-alerter-8jq2w"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714372    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-etc-kubernetes\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-run-k8s-cni-cncf-io\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.715567 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-run-multus-certs\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/738517e4-4a05-4309-85d5-a64743841ce0-iptables-alerter-script\") pod \"iptables-alerter-8jq2w\" (UID: \"738517e4-4a05-4309-85d5-a64743841ce0\") " pod="openshift-network-operator/iptables-alerter-8jq2w"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e22ccf9-a301-4b5a-af20-621e9027b3be-tmp-dir\") pod \"node-resolver-f5c5g\" (UID: \"9e22ccf9-a301-4b5a-af20-621e9027b3be\") " pod="openshift-dns/node-resolver-f5c5g"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-run\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714538    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-run-k8s-cni-cncf-io\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714560    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-run-multus-certs\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbfpm\" (UniqueName: \"kubernetes.io/projected/05b952ef-2750-4877-b7aa-c9e7d5250058-kube-api-access-jbfpm\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-multus-socket-dir-parent\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-sysconfig\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-sysctl-conf\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-systemd\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-device-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714785    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ccdf2e0-1700-429b-8198-0861386af90b-serviceca\") pod \"node-ca-ns7fs\" (UID: \"2ccdf2e0-1700-429b-8198-0861386af90b\") " pod="openshift-image-registry/node-ca-ns7fs"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-system-cni-dir\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.716221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-hostroot\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-multus-conf-dir\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714891    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e22ccf9-a301-4b5a-af20-621e9027b3be-tmp-dir\") pod \"node-resolver-f5c5g\" (UID: \"9e22ccf9-a301-4b5a-af20-621e9027b3be\") " pod="openshift-dns/node-resolver-f5c5g"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txvg8\" (UniqueName: \"kubernetes.io/projected/738517e4-4a05-4309-85d5-a64743841ce0-kube-api-access-txvg8\") pod \"iptables-alerter-8jq2w\" (UID: \"738517e4-4a05-4309-85d5-a64743841ce0\") " pod="openshift-network-operator/iptables-alerter-8jq2w"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-run\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08852625-0839-4870-9c4d-ca1810b955c4-cni-binary-copy\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48883128-e79b-4469-8bcf-92d3adbdbb1c-tmp\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-hostroot\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksw5h\" (UniqueName: \"kubernetes.io/projected/2ccdf2e0-1700-429b-8198-0861386af90b-kube-api-access-ksw5h\") pod \"node-ca-ns7fs\" (UID: \"2ccdf2e0-1700-429b-8198-0861386af90b\") " pod="openshift-image-registry/node-ca-ns7fs"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-sysconfig\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715027    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/08852625-0839-4870-9c4d-ca1810b955c4-multus-daemon-config\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715036    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-cni-binary-copy\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-os-release\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.714988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-multus-conf-dir\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715084    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-var-lib-cni-multus\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e22ccf9-a301-4b5a-af20-621e9027b3be-hosts-file\") pod \"node-resolver-f5c5g\" (UID: \"9e22ccf9-a301-4b5a-af20-621e9027b3be\") " pod="openshift-dns/node-resolver-f5c5g"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-registration-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.717565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715130    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-host-var-lib-cni-multus\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-cnibin\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715194    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-sysctl-conf\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715206    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e22ccf9-a301-4b5a-af20-621e9027b3be-hosts-file\") pod \"node-resolver-f5c5g\" (UID: \"9e22ccf9-a301-4b5a-af20-621e9027b3be\") " pod="openshift-dns/node-resolver-f5c5g"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c5451bb-36cd-45ae-ae95-e7f841df4914-kubelet-config\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715243    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-os-release\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715245    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-device-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c5451bb-36cd-45ae-ae95-e7f841df4914-kubelet-config\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:24.715088    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715291    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-cnibin\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715294    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-systemd\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:24.715316    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret podName:7c5451bb-36cd-45ae-ae95-e7f841df4914 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:25.21530079 +0000 UTC m=+3.078987286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret") pod "global-pull-secret-syncer-9z5k9" (UID: "7c5451bb-36cd-45ae-ae95-e7f841df4914") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-multus-socket-dir-parent\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715313    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/08852625-0839-4870-9c4d-ca1810b955c4-system-cni-dir\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-lib-modules\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715354    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/48883128-e79b-4469-8bcf-92d3adbdbb1c-lib-modules\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-tuned\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715396    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/05b952ef-2750-4877-b7aa-c9e7d5250058-registration-dir\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.718167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.715571    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/08852625-0839-4870-9c4d-ca1810b955c4-cni-binary-copy\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.718781 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.717266    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7769fe0a-f440-4ac6-866c-8c379f4cf6f6-agent-certs\") pod \"konnectivity-agent-dnzkt\" (UID: \"7769fe0a-f440-4ac6-866c-8c379f4cf6f6\") " pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:24.718781 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.717616    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/48883128-e79b-4469-8bcf-92d3adbdbb1c-etc-tuned\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.718781 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.717777    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48883128-e79b-4469-8bcf-92d3adbdbb1c-tmp\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.725446 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:24.725323    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:24.725446 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:24.725345    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:24.725446 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:24.725359    2581 projected.go:196] Error preparing data for projected volume kube-api-access-8mzvj for pod openshift-network-diagnostics/network-check-target-n9pdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:24.725446 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:24.725418    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj podName:83fe65a5-b6cb-4d8a-ac28-84ddb1759da7 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:25.225401899 +0000 UTC m=+3.089088405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8mzvj" (UniqueName: "kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj") pod "network-check-target-n9pdg" (UID: "83fe65a5-b6cb-4d8a-ac28-84ddb1759da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:24.726170 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.725760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f44pv\" (UniqueName: \"kubernetes.io/projected/170cc23c-d32d-44c6-be5b-e8d4a9b175ea-kube-api-access-f44pv\") pod \"multus-additional-cni-plugins-mc2jt\" (UID: \"170cc23c-d32d-44c6-be5b-e8d4a9b175ea\") " pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.726170 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.726127    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxx84\" (UniqueName: \"kubernetes.io/projected/9e22ccf9-a301-4b5a-af20-621e9027b3be-kube-api-access-xxx84\") pod \"node-resolver-f5c5g\" (UID: \"9e22ccf9-a301-4b5a-af20-621e9027b3be\") " pod="openshift-dns/node-resolver-f5c5g"
Jul 12 21:52:24.726170 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.726151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48hdb\" (UniqueName: \"kubernetes.io/projected/08852625-0839-4870-9c4d-ca1810b955c4-kube-api-access-48hdb\") pod \"multus-b6ktm\" (UID: \"08852625-0839-4870-9c4d-ca1810b955c4\") " pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.726652 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.726632    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbfpm\" (UniqueName: \"kubernetes.io/projected/05b952ef-2750-4877-b7aa-c9e7d5250058-kube-api-access-jbfpm\") pod \"aws-ebs-csi-driver-node-hbl4t\" (UID: \"05b952ef-2750-4877-b7aa-c9e7d5250058\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.727996 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.727945    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drfh2\" (UniqueName: \"kubernetes.io/projected/48883128-e79b-4469-8bcf-92d3adbdbb1c-kube-api-access-drfh2\") pod \"tuned-tgb55\" (UID: \"48883128-e79b-4469-8bcf-92d3adbdbb1c\") " pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.730916 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.730893    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf464\" (UniqueName: \"kubernetes.io/projected/6d4a3f48-6604-492c-aa9a-a67a90d378d3-kube-api-access-qf464\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:24.732110 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.732087    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksw5h\" (UniqueName: \"kubernetes.io/projected/2ccdf2e0-1700-429b-8198-0861386af90b-kube-api-access-ksw5h\") pod \"node-ca-ns7fs\" (UID: \"2ccdf2e0-1700-429b-8198-0861386af90b\") " pod="openshift-image-registry/node-ca-ns7fs"
Jul 12 21:52:24.732311 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.732292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txvg8\" (UniqueName: \"kubernetes.io/projected/738517e4-4a05-4309-85d5-a64743841ce0-kube-api-access-txvg8\") pod \"iptables-alerter-8jq2w\" (UID: \"738517e4-4a05-4309-85d5-a64743841ce0\") " pod="openshift-network-operator/iptables-alerter-8jq2w"
Jul 12 21:52:24.815787 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.815753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:24.825044 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.825022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mc2jt"
Jul 12 21:52:24.833039 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.833019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t"
Jul 12 21:52:24.838671 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.838651    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tgb55"
Jul 12 21:52:24.847414 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.847392    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8jq2w"
Jul 12 21:52:24.854348 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.854324    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:24.862161 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.862145    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b6ktm"
Jul 12 21:52:24.869557 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.869538    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f5c5g"
Jul 12 21:52:24.875293 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:24.875275    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ns7fs"
Jul 12 21:52:25.218219 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.218128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:25.218219 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.218206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:25.218442 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:25.218281    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:25.218442 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:25.218295    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:25.218442 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:25.218344    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret podName:7c5451bb-36cd-45ae-ae95-e7f841df4914 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:26.218329506 +0000 UTC m=+4.082015997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret") pod "global-pull-secret-syncer-9z5k9" (UID: "7c5451bb-36cd-45ae-ae95-e7f841df4914") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:25.218442 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:25.218362    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs podName:6d4a3f48-6604-492c-aa9a-a67a90d378d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:26.218352117 +0000 UTC m=+4.082038607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs") pod "network-metrics-daemon-q4z7k" (UID: "6d4a3f48-6604-492c-aa9a-a67a90d378d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:25.319231 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.319192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzvj\" (UniqueName: \"kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj\") pod \"network-check-target-n9pdg\" (UID: \"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7\") " pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:25.319437 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:25.319385    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:25.319437 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:25.319410    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:25.319437 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:25.319424    2581 projected.go:196] Error preparing data for projected volume kube-api-access-8mzvj for pod openshift-network-diagnostics/network-check-target-n9pdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:25.319594 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:25.319481    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj podName:83fe65a5-b6cb-4d8a-ac28-84ddb1759da7 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:26.319462553 +0000 UTC m=+4.183149048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mzvj" (UniqueName: "kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj") pod "network-check-target-n9pdg" (UID: "83fe65a5-b6cb-4d8a-ac28-84ddb1759da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:25.478017 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:25.477991    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ccdf2e0_1700_429b_8198_0861386af90b.slice/crio-7cff5c3cd21a2c0dd57859a63833d267e9e5ecefb2224d4a9ed29d62d801a11f WatchSource:0}: Error finding container 7cff5c3cd21a2c0dd57859a63833d267e9e5ecefb2224d4a9ed29d62d801a11f: Status 404 returned error can't find the container with id 7cff5c3cd21a2c0dd57859a63833d267e9e5ecefb2224d4a9ed29d62d801a11f
Jul 12 21:52:25.479265 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:25.479237    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48883128_e79b_4469_8bcf_92d3adbdbb1c.slice/crio-e6720b02eaabac1fba8aea5344c113bc43d9db06c386a3b16285a62f13289710 WatchSource:0}: Error finding container e6720b02eaabac1fba8aea5344c113bc43d9db06c386a3b16285a62f13289710: Status 404 returned error can't find the container with id e6720b02eaabac1fba8aea5344c113bc43d9db06c386a3b16285a62f13289710
Jul 12 21:52:25.479904 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:25.479874    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b952ef_2750_4877_b7aa_c9e7d5250058.slice/crio-d7f05704fb9dbf18c6d6c745e68cd27173b3ac6dad9c032aef647c6ef9f1e7af WatchSource:0}: Error finding container d7f05704fb9dbf18c6d6c745e68cd27173b3ac6dad9c032aef647c6ef9f1e7af: Status 404 returned error can't find the container with id d7f05704fb9dbf18c6d6c745e68cd27173b3ac6dad9c032aef647c6ef9f1e7af
Jul 12 21:52:25.481608 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:25.481585    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e22ccf9_a301_4b5a_af20_621e9027b3be.slice/crio-57e7e38d7743bfe90deb71811c22547e9b74e35ae8bc446fad0cb39f1b55dad3 WatchSource:0}: Error finding container 57e7e38d7743bfe90deb71811c22547e9b74e35ae8bc446fad0cb39f1b55dad3: Status 404 returned error can't find the container with id 57e7e38d7743bfe90deb71811c22547e9b74e35ae8bc446fad0cb39f1b55dad3
Jul 12 21:52:25.483930 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:25.483776    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738517e4_4a05_4309_85d5_a64743841ce0.slice/crio-224d67014eb20350f2298b007467e499a072968ed890317bca0ad85e2dbf2932 WatchSource:0}: Error finding container 224d67014eb20350f2298b007467e499a072968ed890317bca0ad85e2dbf2932: Status 404 returned error can't find the container with id 224d67014eb20350f2298b007467e499a072968ed890317bca0ad85e2dbf2932
Jul 12 21:52:25.484755 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:25.484734    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod521ee44d_7557_4a46_90be_5574d731b913.slice/crio-797950e84984f7b483343eecd62d4504ba120890317bc8d0dff97a3309971cb9 WatchSource:0}: Error finding container 797950e84984f7b483343eecd62d4504ba120890317bc8d0dff97a3309971cb9: Status 404 returned error can't find the container with id 797950e84984f7b483343eecd62d4504ba120890317bc8d0dff97a3309971cb9
Jul 12 21:52:25.486030 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:25.485868    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170cc23c_d32d_44c6_be5b_e8d4a9b175ea.slice/crio-a8213e24a6406d80f6fe03d05838b627fdb2138e447127b6b345b92def9af5ec WatchSource:0}: Error finding container a8213e24a6406d80f6fe03d05838b627fdb2138e447127b6b345b92def9af5ec: Status 404 returned error can't find the container with id a8213e24a6406d80f6fe03d05838b627fdb2138e447127b6b345b92def9af5ec
Jul 12 21:52:25.487454 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:25.486538    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08852625_0839_4870_9c4d_ca1810b955c4.slice/crio-25ce933a3a7598c7442d18342682dc6ae47087b4d30cefb96a9f4f2076c2712d WatchSource:0}: Error finding container 25ce933a3a7598c7442d18342682dc6ae47087b4d30cefb96a9f4f2076c2712d: Status 404 returned error can't find the container with id 25ce933a3a7598c7442d18342682dc6ae47087b4d30cefb96a9f4f2076c2712d
Jul 12 21:52:25.487816 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:25.487797    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7769fe0a_f440_4ac6_866c_8c379f4cf6f6.slice/crio-ea4f0cb817ec900244996c94f3689d819d640458619a5b8d2bf7792b290ce7f6 WatchSource:0}: Error finding container ea4f0cb817ec900244996c94f3689d819d640458619a5b8d2bf7792b290ce7f6: Status 404 returned error can't find the container with id ea4f0cb817ec900244996c94f3689d819d640458619a5b8d2bf7792b290ce7f6
Jul 12 21:52:25.544441 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.544399    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 21:47:24 +0000 UTC" deadline="2028-01-25 11:42:46.165166263 +0000 UTC"
Jul 12 21:52:25.544441 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.544438    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13477h50m20.620730116s"
Jul 12 21:52:25.664170 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.664017    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:25.664290 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:25.664244    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:25.673976 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.673944    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mc2jt" event={"ID":"170cc23c-d32d-44c6-be5b-e8d4a9b175ea","Type":"ContainerStarted","Data":"a8213e24a6406d80f6fe03d05838b627fdb2138e447127b6b345b92def9af5ec"}
Jul 12 21:52:25.675206 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.675183    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f5c5g" event={"ID":"9e22ccf9-a301-4b5a-af20-621e9027b3be","Type":"ContainerStarted","Data":"57e7e38d7743bfe90deb71811c22547e9b74e35ae8bc446fad0cb39f1b55dad3"}
Jul 12 21:52:25.676243 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.676222    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t" event={"ID":"05b952ef-2750-4877-b7aa-c9e7d5250058","Type":"ContainerStarted","Data":"d7f05704fb9dbf18c6d6c745e68cd27173b3ac6dad9c032aef647c6ef9f1e7af"}
Jul 12 21:52:25.677192 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.677172    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ns7fs" event={"ID":"2ccdf2e0-1700-429b-8198-0861386af90b","Type":"ContainerStarted","Data":"7cff5c3cd21a2c0dd57859a63833d267e9e5ecefb2224d4a9ed29d62d801a11f"}
Jul 12 21:52:25.678119 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.678100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dnzkt" event={"ID":"7769fe0a-f440-4ac6-866c-8c379f4cf6f6","Type":"ContainerStarted","Data":"ea4f0cb817ec900244996c94f3689d819d640458619a5b8d2bf7792b290ce7f6"}
Jul 12 21:52:25.679118 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.679097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b6ktm" event={"ID":"08852625-0839-4870-9c4d-ca1810b955c4","Type":"ContainerStarted","Data":"25ce933a3a7598c7442d18342682dc6ae47087b4d30cefb96a9f4f2076c2712d"}
Jul 12 21:52:25.680125 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.680108    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8" event={"ID":"521ee44d-7557-4a46-90be-5574d731b913","Type":"ContainerStarted","Data":"797950e84984f7b483343eecd62d4504ba120890317bc8d0dff97a3309971cb9"}
Jul 12 21:52:25.681076 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.681056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8jq2w" event={"ID":"738517e4-4a05-4309-85d5-a64743841ce0","Type":"ContainerStarted","Data":"224d67014eb20350f2298b007467e499a072968ed890317bca0ad85e2dbf2932"}
Jul 12 21:52:25.682008 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.681988    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tgb55" event={"ID":"48883128-e79b-4469-8bcf-92d3adbdbb1c","Type":"ContainerStarted","Data":"e6720b02eaabac1fba8aea5344c113bc43d9db06c386a3b16285a62f13289710"}
Jul 12 21:52:25.683727 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.683709    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" event={"ID":"59a0a931653a6c997ccb77f8eb321696","Type":"ContainerStarted","Data":"c1d05586c68ab3463c63bfd33a9d05038b8105bf56b5f09665d2d8c4d83b1609"}
Jul 12 21:52:25.699692 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:25.699566    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-64.ec2.internal" podStartSLOduration=1.699551661 podStartE2EDuration="1.699551661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:25.699059115 +0000 UTC m=+3.562745627" watchObservedRunningTime="2026-07-12 21:52:25.699551661 +0000 UTC m=+3.563238174"
Jul 12 21:52:26.226069 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:26.225820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:26.226069 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:26.225906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:26.226069 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:26.225987    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:26.226069 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:26.226016    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:26.226069 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:26.226063    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs podName:6d4a3f48-6604-492c-aa9a-a67a90d378d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:28.226041811 +0000 UTC m=+6.089728305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs") pod "network-metrics-daemon-q4z7k" (UID: "6d4a3f48-6604-492c-aa9a-a67a90d378d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:26.226069 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:26.226083    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret podName:7c5451bb-36cd-45ae-ae95-e7f841df4914 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:28.226073209 +0000 UTC m=+6.089759705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret") pod "global-pull-secret-syncer-9z5k9" (UID: "7c5451bb-36cd-45ae-ae95-e7f841df4914") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:26.326766 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:26.326730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzvj\" (UniqueName: \"kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj\") pod \"network-check-target-n9pdg\" (UID: \"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7\") " pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:26.326978 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:26.326960    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:26.327045 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:26.326982    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:26.327045 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:26.326996    2581 projected.go:196] Error preparing data for projected volume kube-api-access-8mzvj for pod openshift-network-diagnostics/network-check-target-n9pdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:26.327181 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:26.327063    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj podName:83fe65a5-b6cb-4d8a-ac28-84ddb1759da7 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:28.327035513 +0000 UTC m=+6.190722007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mzvj" (UniqueName: "kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj") pod "network-check-target-n9pdg" (UID: "83fe65a5-b6cb-4d8a-ac28-84ddb1759da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:26.544920 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:26.544728    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 21:47:24 +0000 UTC" deadline="2027-12-22 17:51:25.961552164 +0000 UTC"
Jul 12 21:52:26.544920 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:26.544766    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12667h58m59.416790841s"
Jul 12 21:52:26.664424 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:26.663839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:26.664424 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:26.663968    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:26.664424 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:26.664293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:26.664424 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:26.664383    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:26.701081 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:26.701049    2581 generic.go:356] "Generic (PLEG): container finished" podID="7615c3a8f34a3b249ea13dab5c9e3cbb" containerID="e2242b4287bf6d16681f39d29c2342fae2a7b72f816d3ae9a06e9c6f96ae5151" exitCode=0
Jul 12 21:52:26.701774 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:26.701752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" event={"ID":"7615c3a8f34a3b249ea13dab5c9e3cbb","Type":"ContainerDied","Data":"e2242b4287bf6d16681f39d29c2342fae2a7b72f816d3ae9a06e9c6f96ae5151"}
Jul 12 21:52:27.663339 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:27.663310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:27.663809 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:27.663449    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:27.722395 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:27.721773    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" event={"ID":"7615c3a8f34a3b249ea13dab5c9e3cbb","Type":"ContainerStarted","Data":"3b9196950882631bb99ae7bd4ff94dedd9f35b988bdb5ab60b6a95d4b0ea41ee"}
Jul 12 21:52:27.741528 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:27.741475    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-64.ec2.internal" podStartSLOduration=3.741454581 podStartE2EDuration="3.741454581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:27.741292521 +0000 UTC m=+5.604979035" watchObservedRunningTime="2026-07-12 21:52:27.741454581 +0000 UTC m=+5.605141094"
Jul 12 21:52:28.244367 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:28.243582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:28.244367 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:28.243649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:28.244367 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:28.243809    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:28.244367 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:28.243869    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs podName:6d4a3f48-6604-492c-aa9a-a67a90d378d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:32.243850989 +0000 UTC m=+10.107537483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs") pod "network-metrics-daemon-q4z7k" (UID: "6d4a3f48-6604-492c-aa9a-a67a90d378d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:28.244367 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:28.244231    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:28.244367 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:28.244282    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret podName:7c5451bb-36cd-45ae-ae95-e7f841df4914 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:32.244265738 +0000 UTC m=+10.107952244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret") pod "global-pull-secret-syncer-9z5k9" (UID: "7c5451bb-36cd-45ae-ae95-e7f841df4914") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:28.344974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:28.344939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzvj\" (UniqueName: \"kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj\") pod \"network-check-target-n9pdg\" (UID: \"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7\") " pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:28.345151 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:28.345127    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:28.345221 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:28.345158    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:28.345221 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:28.345172    2581 projected.go:196] Error preparing data for projected volume kube-api-access-8mzvj for pod openshift-network-diagnostics/network-check-target-n9pdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:28.345342 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:28.345228    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj podName:83fe65a5-b6cb-4d8a-ac28-84ddb1759da7 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:32.345210244 +0000 UTC m=+10.208896739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mzvj" (UniqueName: "kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj") pod "network-check-target-n9pdg" (UID: "83fe65a5-b6cb-4d8a-ac28-84ddb1759da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:28.663472 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:28.663239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:28.663472 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:28.663365    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:28.664028 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:28.663859    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:28.664028 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:28.663976    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:29.663881 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:29.663848    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:29.664357 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:29.663992    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:30.666068 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:30.666038    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:30.666524 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:30.666162    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:30.666524 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:30.666177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:30.666524 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:30.666247    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:31.663937 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:31.663903    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:31.664131 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:31.664036    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:32.276204 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:32.276022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:32.276204 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:32.276082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:32.276204 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:32.276181    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:32.276776 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:32.276249    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret podName:7c5451bb-36cd-45ae-ae95-e7f841df4914 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:40.27622825 +0000 UTC m=+18.139914745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret") pod "global-pull-secret-syncer-9z5k9" (UID: "7c5451bb-36cd-45ae-ae95-e7f841df4914") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:32.276776 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:32.276184    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:32.276776 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:32.276591    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs podName:6d4a3f48-6604-492c-aa9a-a67a90d378d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:40.276573518 +0000 UTC m=+18.140260027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs") pod "network-metrics-daemon-q4z7k" (UID: "6d4a3f48-6604-492c-aa9a-a67a90d378d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:32.376964 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:32.376923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzvj\" (UniqueName: \"kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj\") pod \"network-check-target-n9pdg\" (UID: \"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7\") " pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:32.377126 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:32.377109    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:32.377184 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:32.377131    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:32.377184 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:32.377144    2581 projected.go:196] Error preparing data for projected volume kube-api-access-8mzvj for pod openshift-network-diagnostics/network-check-target-n9pdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:32.377278 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:32.377199    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj podName:83fe65a5-b6cb-4d8a-ac28-84ddb1759da7 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:40.377181184 +0000 UTC m=+18.240867677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mzvj" (UniqueName: "kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj") pod "network-check-target-n9pdg" (UID: "83fe65a5-b6cb-4d8a-ac28-84ddb1759da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:32.665669 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:32.665584    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:32.665858 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:32.665725    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:32.665858 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:32.665746    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:32.665858 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:32.665845    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:33.663984 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:33.663943    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:33.664496 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:33.664113    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:34.663967 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:34.663785    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:34.663967 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:34.663923    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:34.663967 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:34.663949    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:34.664524 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:34.664062    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:35.663518 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:35.663488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:35.663687 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:35.663608    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:36.663891 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:36.663859    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:36.664337 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:36.663988    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:36.664337 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:36.664052    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:36.664337 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:36.664170    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:37.663247 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:37.663214    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:37.663430 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:37.663350    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:38.663378 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:38.663345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:38.663815 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:38.663348    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:38.663815 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:38.663483    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:38.663815 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:38.663559    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:39.663396 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:39.663371    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:39.663794 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:39.663468    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:40.337476 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:40.337441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:40.337637 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:40.337520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:40.337637 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:40.337603    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:40.337776 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:40.337675    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs podName:6d4a3f48-6604-492c-aa9a-a67a90d378d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:56.337652614 +0000 UTC m=+34.201339128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs") pod "network-metrics-daemon-q4z7k" (UID: "6d4a3f48-6604-492c-aa9a-a67a90d378d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:40.337776 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:40.337609    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:40.337776 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:40.337735    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret podName:7c5451bb-36cd-45ae-ae95-e7f841df4914 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:56.337727128 +0000 UTC m=+34.201413618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret") pod "global-pull-secret-syncer-9z5k9" (UID: "7c5451bb-36cd-45ae-ae95-e7f841df4914") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:40.438365 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:40.438327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzvj\" (UniqueName: \"kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj\") pod \"network-check-target-n9pdg\" (UID: \"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7\") " pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:40.438547 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:40.438524    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:40.438606 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:40.438555    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:40.438606 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:40.438570    2581 projected.go:196] Error preparing data for projected volume kube-api-access-8mzvj for pod openshift-network-diagnostics/network-check-target-n9pdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:40.438673 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:40.438634    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj podName:83fe65a5-b6cb-4d8a-ac28-84ddb1759da7 nodeName:}" failed. No retries permitted until 2026-07-12 21:52:56.438615168 +0000 UTC m=+34.302301678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mzvj" (UniqueName: "kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj") pod "network-check-target-n9pdg" (UID: "83fe65a5-b6cb-4d8a-ac28-84ddb1759da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:40.663984 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:40.663909    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:40.664400 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:40.664041    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:40.664400 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:40.664104    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:40.664400 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:40.664221    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:41.664008 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:41.663975    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:41.664414 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:41.664095    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:42.664311 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:42.664277    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:42.664784 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:42.664374    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:42.664784 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:42.664644    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:42.664886 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:42.664781    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:43.663282 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:43.663252    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:43.663440 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:43.663367    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:44.664297 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.664018    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:44.664870 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.664086    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:44.664870 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:44.664371    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:44.664870 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:44.664435    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:44.753169 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.753131    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dnzkt" event={"ID":"7769fe0a-f440-4ac6-866c-8c379f4cf6f6","Type":"ContainerStarted","Data":"334bb232a1ae1ce5831a585d3424a231613b75281b6a641d4d479199bbdcba09"}
Jul 12 21:52:44.754889 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.754859    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b6ktm" event={"ID":"08852625-0839-4870-9c4d-ca1810b955c4","Type":"ContainerStarted","Data":"c2301b2847caf475070885db90bd1b6f1242db1bc6baf6b2f99b0fbfb3d10923"}
Jul 12 21:52:44.757619 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.757597    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 21:52:44.758035 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.758012    2581 generic.go:356] "Generic (PLEG): container finished" podID="521ee44d-7557-4a46-90be-5574d731b913" containerID="bda7ffdc9aca1df8adf5aad7c476f89bd7f5aeee3fe8f1ccf1a03972c04c052e" exitCode=1
Jul 12 21:52:44.758112 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.758085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8" event={"ID":"521ee44d-7557-4a46-90be-5574d731b913","Type":"ContainerStarted","Data":"81a9303513c84060189d0033c5853150185762f0e112ffb4be87d9d321c18f33"}
Jul 12 21:52:44.758177 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.758162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8" event={"ID":"521ee44d-7557-4a46-90be-5574d731b913","Type":"ContainerStarted","Data":"b3c8e14080ecf86592c43ba206a9ca7679d78d7b4c0398f2726c36f16ecee753"}
Jul 12 21:52:44.758228 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.758218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8" event={"ID":"521ee44d-7557-4a46-90be-5574d731b913","Type":"ContainerStarted","Data":"cd5936f5620c86c75d3eaacf359f8048fbfe767f3292422b7d3984089bb848e4"}
Jul 12 21:52:44.758274 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.758263    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8" event={"ID":"521ee44d-7557-4a46-90be-5574d731b913","Type":"ContainerDied","Data":"bda7ffdc9aca1df8adf5aad7c476f89bd7f5aeee3fe8f1ccf1a03972c04c052e"}
Jul 12 21:52:44.758329 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.758314    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8" event={"ID":"521ee44d-7557-4a46-90be-5574d731b913","Type":"ContainerStarted","Data":"f5166c258a1da6870c9496942828dff7eaac4c16095ac50c69e992dde440e5d3"}
Jul 12 21:52:44.759635 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.759614    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tgb55" event={"ID":"48883128-e79b-4469-8bcf-92d3adbdbb1c","Type":"ContainerStarted","Data":"7e382c5d9c0bb4bc97bddb29c1e4b5c6784fe26b7497ef5f9275429f82d41c68"}
Jul 12 21:52:44.761138 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.761114    2581 generic.go:356] "Generic (PLEG): container finished" podID="170cc23c-d32d-44c6-be5b-e8d4a9b175ea" containerID="8f21be903eb817b9a923f8e4a1131988b1f6cffea29a118d645a58a7e86ae1c0" exitCode=0
Jul 12 21:52:44.761225 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.761194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mc2jt" event={"ID":"170cc23c-d32d-44c6-be5b-e8d4a9b175ea","Type":"ContainerDied","Data":"8f21be903eb817b9a923f8e4a1131988b1f6cffea29a118d645a58a7e86ae1c0"}
Jul 12 21:52:44.762756 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.762658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f5c5g" event={"ID":"9e22ccf9-a301-4b5a-af20-621e9027b3be","Type":"ContainerStarted","Data":"41f2541a78bfaf852fb2095eff7075867b9ee8091fd7dd9a82781ac89494a340"}
Jul 12 21:52:44.764092 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.764069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t" event={"ID":"05b952ef-2750-4877-b7aa-c9e7d5250058","Type":"ContainerStarted","Data":"ede4b1902a9c58c54e22ccbe6215243bab0ddcbb047a9b96b24e08a884407367"}
Jul 12 21:52:44.765753 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.765731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ns7fs" event={"ID":"2ccdf2e0-1700-429b-8198-0861386af90b","Type":"ContainerStarted","Data":"92b62dbe593a85205006a880cb14a0cdc2158e7ed04b67149e6f5e0d546e58a9"}
Jul 12 21:52:44.771025 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.770984    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dnzkt" podStartSLOduration=4.191827135 podStartE2EDuration="22.770969291s" totalImagesPullingTime="18.579142156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:44.770382888 +0000 UTC m=+22.634069412" watchObservedRunningTime="2026-07-12 21:52:44.770969291 +0000 UTC m=+22.634655805"
Jul 12 21:52:44.808283 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.807974    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tgb55" podStartSLOduration=4.2199811799999996 podStartE2EDuration="22.807954682s" totalImagesPullingTime="18.587973502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:44.807597258 +0000 UTC m=+22.671283769" watchObservedRunningTime="2026-07-12 21:52:44.807954682 +0000 UTC m=+22.671641195"
Jul 12 21:52:44.808495 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.808456    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f5c5g" podStartSLOduration=4.219337839 podStartE2EDuration="22.808445948s" totalImagesPullingTime="18.589108109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:44.787417533 +0000 UTC m=+22.651104046" watchObservedRunningTime="2026-07-12 21:52:44.808445948 +0000 UTC m=+22.672132462"
Jul 12 21:52:44.823325 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.823282    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ns7fs" podStartSLOduration=4.236191654 podStartE2EDuration="22.823266589s" totalImagesPullingTime="18.587074935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:44.822908358 +0000 UTC m=+22.686594891" watchObservedRunningTime="2026-07-12 21:52:44.823266589 +0000 UTC m=+22.686953105"
Jul 12 21:52:44.863891 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:44.863784    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b6ktm" podStartSLOduration=4.239692858 podStartE2EDuration="22.863769602s" totalImagesPullingTime="18.624076744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:44.86312769 +0000 UTC m=+22.726814228" watchObservedRunningTime="2026-07-12 21:52:44.863769602 +0000 UTC m=+22.727456114"
Jul 12 21:52:45.421502 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:45.421478    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 12 21:52:45.565225 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:45.565051    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T21:52:45.421496171Z","UUID":"c130d9de-7dc7-434b-830a-68f94251d146","Handler":null,"Name":"","Endpoint":""}
Jul 12 21:52:45.566658 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:45.566638    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 12 21:52:45.566796 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:45.566672    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 12 21:52:45.663432 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:45.663402    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:45.663594 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:45.663507    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:45.770780 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:45.770743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t" event={"ID":"05b952ef-2750-4877-b7aa-c9e7d5250058","Type":"ContainerStarted","Data":"5bf791933a0f68026c4f0904cd7286ea35e94361fae9c960a297a03aa31d9629"}
Jul 12 21:52:45.773777 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:45.773747    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 21:52:45.774161 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:45.774140    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8" event={"ID":"521ee44d-7557-4a46-90be-5574d731b913","Type":"ContainerStarted","Data":"8c4f818dad2916a45ff1c8138ada646901d693e0e07bba453f1c07feba7fdf77"}
Jul 12 21:52:45.775860 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:45.775827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8jq2w" event={"ID":"738517e4-4a05-4309-85d5-a64743841ce0","Type":"ContainerStarted","Data":"0188c585024c469220c2ba95935ec449c986d14ab7ef4d2ebb9b51a2c7e3a22b"}
Jul 12 21:52:46.302872 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:46.302841    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:46.303387 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:46.303371    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:46.321041 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:46.320998    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8jq2w" podStartSLOduration=5.737345202 podStartE2EDuration="24.320983982s" totalImagesPullingTime="18.58363878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:45.794140572 +0000 UTC m=+23.657827085" watchObservedRunningTime="2026-07-12 21:52:46.320983982 +0000 UTC m=+24.184670495"
Jul 12 21:52:46.663937 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:46.663905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:46.664093 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:46.663905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:46.664093 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:46.664046    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:46.664249 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:46.664179    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:46.779886 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:46.779851    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t" event={"ID":"05b952ef-2750-4877-b7aa-c9e7d5250058","Type":"ContainerStarted","Data":"82263f6c776485f3646b3cf4de199a3d70f9eed669778f16b6c6bf8e18e375ef"}
Jul 12 21:52:46.799295 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:46.799253    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hbl4t" podStartSLOduration=4.080416765 podStartE2EDuration="24.799236285s" totalImagesPullingTime="20.71881952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:46.799033445 +0000 UTC m=+24.662719959" watchObservedRunningTime="2026-07-12 21:52:46.799236285 +0000 UTC m=+24.662922797"
Jul 12 21:52:47.200212 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:47.200128    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:47.200817 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:47.200790    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dnzkt"
Jul 12 21:52:47.663746 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:47.663489    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:47.663885 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:47.663813    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:47.785659 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:47.785634    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 21:52:47.786070 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:47.786047    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8" event={"ID":"521ee44d-7557-4a46-90be-5574d731b913","Type":"ContainerStarted","Data":"d86d43a7f864a99fe0d409ce961fc95bae3002cc553d3e03bd1b8d5afa14cc09"}
Jul 12 21:52:48.663253 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:48.663224    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:48.663431 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:48.663348    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:48.663431 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:48.663384    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:48.663505 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:48.663460    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:49.664079 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:49.663904    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:49.664749 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:49.664153    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:49.792135 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:49.792108    2581 generic.go:356] "Generic (PLEG): container finished" podID="170cc23c-d32d-44c6-be5b-e8d4a9b175ea" containerID="1814d8c761e4b12f8e1ac791a9cb8cf773cc6130858a3f6cfbfb742c950cd7c3" exitCode=0
Jul 12 21:52:49.792283 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:49.792192    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mc2jt" event={"ID":"170cc23c-d32d-44c6-be5b-e8d4a9b175ea","Type":"ContainerDied","Data":"1814d8c761e4b12f8e1ac791a9cb8cf773cc6130858a3f6cfbfb742c950cd7c3"}
Jul 12 21:52:49.795660 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:49.795644    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 21:52:49.796005 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:49.795987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8" event={"ID":"521ee44d-7557-4a46-90be-5574d731b913","Type":"ContainerStarted","Data":"f9906bf76aadd81d6e0e533d09084596f6b321297f6c48772d0e5aa740fa430b"}
Jul 12 21:52:49.796223 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:49.796206    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:49.796384 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:49.796370    2581 scope.go:117] "RemoveContainer" containerID="bda7ffdc9aca1df8adf5aad7c476f89bd7f5aeee3fe8f1ccf1a03972c04c052e"
Jul 12 21:52:49.812596 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:49.812578    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:50.663868 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:50.663838    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:50.664078 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:50.663936    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:50.664078 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:50.663987    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:50.664454 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:50.664074    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:50.802132 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:50.802068    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 21:52:50.802503 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:50.802477    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8" event={"ID":"521ee44d-7557-4a46-90be-5574d731b913","Type":"ContainerStarted","Data":"6d03e760d06811c0b3e3a0360d66779d950947b0c534c584cd084636e1ea52dc"}
Jul 12 21:52:50.802888 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:50.802864    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:50.802999 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:50.802930    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:50.817586 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:50.817567    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:52:50.859315 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:50.859267    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8" podStartSLOduration=10.183731968 podStartE2EDuration="28.859245929s" totalImagesPullingTime="18.675513961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:50.857499249 +0000 UTC m=+28.721185781" watchObservedRunningTime="2026-07-12 21:52:50.859245929 +0000 UTC m=+28.722932442"
Jul 12 21:52:51.197978 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:51.197743    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9z5k9"]
Jul 12 21:52:51.198116 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:51.198077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:51.198218 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:51.198196    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:51.201346 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:51.201322    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q4z7k"]
Jul 12 21:52:51.201453 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:51.201408    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:51.201492 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:51.201478    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:51.217844 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:51.217819    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9pdg"]
Jul 12 21:52:51.217956 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:51.217903    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:51.217993 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:51.217979    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:51.807197 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:51.807160    2581 generic.go:356] "Generic (PLEG): container finished" podID="170cc23c-d32d-44c6-be5b-e8d4a9b175ea" containerID="4924fd201f36f18d7cc8bbb12d980b161dad2e29e33754d816cdba1cc33f1814" exitCode=0
Jul 12 21:52:51.807565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:51.807196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mc2jt" event={"ID":"170cc23c-d32d-44c6-be5b-e8d4a9b175ea","Type":"ContainerDied","Data":"4924fd201f36f18d7cc8bbb12d980b161dad2e29e33754d816cdba1cc33f1814"}
Jul 12 21:52:52.663940 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:52.663909    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:52.664128 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:52.663989    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:52.664128 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:52.664079    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:52.664215 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:52.664193    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:52.664288 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:52.664270    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:52.664384 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:52.664368    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:53.815373 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:53.815342    2581 generic.go:356] "Generic (PLEG): container finished" podID="170cc23c-d32d-44c6-be5b-e8d4a9b175ea" containerID="abb0f675dff6472c67cc7e57267f385d7ca26a4351c94eb8e0b355c2b97eedb6" exitCode=0
Jul 12 21:52:53.815947 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:53.815385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mc2jt" event={"ID":"170cc23c-d32d-44c6-be5b-e8d4a9b175ea","Type":"ContainerDied","Data":"abb0f675dff6472c67cc7e57267f385d7ca26a4351c94eb8e0b355c2b97eedb6"}
Jul 12 21:52:54.067246 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:54.067169    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:54.177976 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:54.177929    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:54.664093 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:54.664062    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:54.664257 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:54.664062    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:54.664257 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:54.664191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:54.664257 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:54.664190    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:54.664378 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:54.664296    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:54.664417 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:54.664387    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:55.379381 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:55.379350    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:55.556307 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:55.556273    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:56.226127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.226039    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:56.316547 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.316474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:56.358401 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.358377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:56.358570 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.358432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:56.358570 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:56.358493    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:56.358570 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:56.358531    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:56.358570 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:56.358557    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret podName:7c5451bb-36cd-45ae-ae95-e7f841df4914 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:28.358539035 +0000 UTC m=+66.222225538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret") pod "global-pull-secret-syncer-9z5k9" (UID: "7c5451bb-36cd-45ae-ae95-e7f841df4914") : object "kube-system"/"original-pull-secret" not registered
Jul 12 21:52:56.358570 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:56.358574    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs podName:6d4a3f48-6604-492c-aa9a-a67a90d378d3 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:28.358566207 +0000 UTC m=+66.222252704 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs") pod "network-metrics-daemon-q4z7k" (UID: "6d4a3f48-6604-492c-aa9a-a67a90d378d3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 12 21:52:56.414814 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.414784    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:56.458957 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.458924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzvj\" (UniqueName: \"kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj\") pod \"network-check-target-n9pdg\" (UID: \"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7\") " pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:56.459110 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:56.459072    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 12 21:52:56.459110 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:56.459092    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 12 21:52:56.459110 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:56.459104    2581 projected.go:196] Error preparing data for projected volume kube-api-access-8mzvj for pod openshift-network-diagnostics/network-check-target-n9pdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:56.459289 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:56.459151    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj podName:83fe65a5-b6cb-4d8a-ac28-84ddb1759da7 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:28.459138343 +0000 UTC m=+66.322824834 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8mzvj" (UniqueName: "kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj") pod "network-check-target-n9pdg" (UID: "83fe65a5-b6cb-4d8a-ac28-84ddb1759da7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 12 21:52:56.516431 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.516342    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:56.618931 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.618896    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:56.664125 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.664100    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:56.664125 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.664112    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:56.664339 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:56.664223    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9z5k9" podUID="7c5451bb-36cd-45ae-ae95-e7f841df4914"
Jul 12 21:52:56.664339 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:56.664271    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n9pdg" podUID="83fe65a5-b6cb-4d8a-ac28-84ddb1759da7"
Jul 12 21:52:56.664339 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.664308    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:56.664453 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:56.664400    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q4z7k" podUID="6d4a3f48-6604-492c-aa9a-a67a90d378d3"
Jul 12 21:52:56.717800 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:56.717764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:57.763877 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:57.763684    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:57.827635 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:57.827588    2581 generic.go:356] "Generic (PLEG): container finished" podID="170cc23c-d32d-44c6-be5b-e8d4a9b175ea" containerID="d004146d944767fec455cc983fe4fdb6865b56c12f2b661d63db78d958f9a79b" exitCode=0
Jul 12 21:52:57.827635 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:57.827623    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mc2jt" event={"ID":"170cc23c-d32d-44c6-be5b-e8d4a9b175ea","Type":"ContainerDied","Data":"d004146d944767fec455cc983fe4fdb6865b56c12f2b661d63db78d958f9a79b"}
Jul 12 21:52:57.858741 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:57.858715    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:57.977102 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:57.977078    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-64.ec2.internal" event="NodeReady"
Jul 12 21:52:57.977205 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:57.977194    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 12 21:52:58.029449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.029418    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7b7nt"]
Jul 12 21:52:58.031052 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.031037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.031867 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.031847    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rn82d"]
Jul 12 21:52:58.033547 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.033530    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rn82d"
Jul 12 21:52:58.033650 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.033629    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 12 21:52:58.033798 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.033780    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 12 21:52:58.034047 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.034035    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6dkr4\""
Jul 12 21:52:58.036277 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.036259    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 12 21:52:58.036362 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.036295    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2rf25\""
Jul 12 21:52:58.036644 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.036615    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 12 21:52:58.036954 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.036936    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 12 21:52:58.048453 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.048431    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7b7nt"]
Jul 12 21:52:58.053093 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.053074    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rn82d"]
Jul 12 21:52:58.167485 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.167450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:58.173464 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.173442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-config-volume\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.173531 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.173471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf26l\" (UniqueName: \"kubernetes.io/projected/08433406-21df-4003-8a8e-7aae7c0d5632-kube-api-access-hf26l\") pod \"ingress-canary-rn82d\" (UID: \"08433406-21df-4003-8a8e-7aae7c0d5632\") " pod="openshift-ingress-canary/ingress-canary-rn82d"
Jul 12 21:52:58.173531 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.173506    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-tmp-dir\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.173614 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.173557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm4l6\" (UniqueName: \"kubernetes.io/projected/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-kube-api-access-pm4l6\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.173614 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.173583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08433406-21df-4003-8a8e-7aae7c0d5632-cert\") pod \"ingress-canary-rn82d\" (UID: \"08433406-21df-4003-8a8e-7aae7c0d5632\") " pod="openshift-ingress-canary/ingress-canary-rn82d"
Jul 12 21:52:58.173614 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.173607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.272159 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.272130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:52:58.274173 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.274155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-tmp-dir\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.274234 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.274180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm4l6\" (UniqueName: \"kubernetes.io/projected/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-kube-api-access-pm4l6\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.274234 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.274197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08433406-21df-4003-8a8e-7aae7c0d5632-cert\") pod \"ingress-canary-rn82d\" (UID: \"08433406-21df-4003-8a8e-7aae7c0d5632\") " pod="openshift-ingress-canary/ingress-canary-rn82d"
Jul 12 21:52:58.274234 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.274217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.274338 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.274278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-config-volume\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.274338 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.274302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf26l\" (UniqueName: \"kubernetes.io/projected/08433406-21df-4003-8a8e-7aae7c0d5632-kube-api-access-hf26l\") pod \"ingress-canary-rn82d\" (UID: \"08433406-21df-4003-8a8e-7aae7c0d5632\") " pod="openshift-ingress-canary/ingress-canary-rn82d"
Jul 12 21:52:58.274425 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:58.274371    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:52:58.274473 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:58.274438    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls podName:35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef nodeName:}" failed. No retries permitted until 2026-07-12 21:52:58.77441957 +0000 UTC m=+36.638106060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls") pod "dns-default-7b7nt" (UID: "35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef") : secret "dns-default-metrics-tls" not found
Jul 12 21:52:58.274566 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.274548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-tmp-dir\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.274848 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.274827    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-config-volume\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.278329 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.278310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08433406-21df-4003-8a8e-7aae7c0d5632-cert\") pod \"ingress-canary-rn82d\" (UID: \"08433406-21df-4003-8a8e-7aae7c0d5632\") " pod="openshift-ingress-canary/ingress-canary-rn82d"
Jul 12 21:52:58.292016 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.291998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm4l6\" (UniqueName: \"kubernetes.io/projected/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-kube-api-access-pm4l6\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.293027 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.293012    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf26l\" (UniqueName: \"kubernetes.io/projected/08433406-21df-4003-8a8e-7aae7c0d5632-kube-api-access-hf26l\") pod \"ingress-canary-rn82d\" (UID: \"08433406-21df-4003-8a8e-7aae7c0d5632\") " pod="openshift-ingress-canary/ingress-canary-rn82d"
Jul 12 21:52:58.347970 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.347954    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rn82d"
Jul 12 21:52:58.476069 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.476041    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rn82d"]
Jul 12 21:52:58.479771 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:52:58.479751    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08433406_21df_4003_8a8e_7aae7c0d5632.slice/crio-0022a979606c005dc4e95b426d1bfbdfb1de13229b63517c721ef7d0a0a0a827 WatchSource:0}: Error finding container 0022a979606c005dc4e95b426d1bfbdfb1de13229b63517c721ef7d0a0a0a827: Status 404 returned error can't find the container with id 0022a979606c005dc4e95b426d1bfbdfb1de13229b63517c721ef7d0a0a0a827
Jul 12 21:52:58.663068 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.663038    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:52:58.663206 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.663038    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:52:58.663206 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.663177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:52:58.666357 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.666320    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j98hn\""
Jul 12 21:52:58.666357 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.666349    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4x2vl\""
Jul 12 21:52:58.666568 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.666370    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 21:52:58.666568 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.666387    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 21:52:58.666568 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.666351    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 21:52:58.666568 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.666320    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 21:52:58.777082 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.777005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:58.777470 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:58.777174    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:52:58.777470 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:58.777260    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls podName:35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef nodeName:}" failed. No retries permitted until 2026-07-12 21:52:59.777238126 +0000 UTC m=+37.640924632 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls") pod "dns-default-7b7nt" (UID: "35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef") : secret "dns-default-metrics-tls" not found
Jul 12 21:52:58.831341 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.831297    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rn82d" event={"ID":"08433406-21df-4003-8a8e-7aae7c0d5632","Type":"ContainerStarted","Data":"0022a979606c005dc4e95b426d1bfbdfb1de13229b63517c721ef7d0a0a0a827"}
Jul 12 21:52:58.834609 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.834582    2581 generic.go:356] "Generic (PLEG): container finished" podID="170cc23c-d32d-44c6-be5b-e8d4a9b175ea" containerID="07af51dd1aecc1e92b25a1ad3075fac4b9a8b5839589e66e363efcb7cdc54fa1" exitCode=0
Jul 12 21:52:58.834740 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:58.834632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mc2jt" event={"ID":"170cc23c-d32d-44c6-be5b-e8d4a9b175ea","Type":"ContainerDied","Data":"07af51dd1aecc1e92b25a1ad3075fac4b9a8b5839589e66e363efcb7cdc54fa1"}
Jul 12 21:52:59.784147 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:59.783949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:52:59.784644 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:59.784090    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:52:59.784644 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:52:59.784234    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls podName:35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef nodeName:}" failed. No retries permitted until 2026-07-12 21:53:01.784219631 +0000 UTC m=+39.647906125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls") pod "dns-default-7b7nt" (UID: "35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef") : secret "dns-default-metrics-tls" not found
Jul 12 21:52:59.841894 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:59.841852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mc2jt" event={"ID":"170cc23c-d32d-44c6-be5b-e8d4a9b175ea","Type":"ContainerStarted","Data":"477834be515b58007528583c5443ccceddc9ae12452b8542d829841036db0ad3"}
Jul 12 21:52:59.883761 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:52:59.883690    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mc2jt" podStartSLOduration=9.284160147 podStartE2EDuration="37.883667467s" totalImagesPullingTime="28.59950732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:52:59.881941589 +0000 UTC m=+37.745628115" watchObservedRunningTime="2026-07-12 21:52:59.883667467 +0000 UTC m=+37.747353983"
Jul 12 21:53:00.023623 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:00.023586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:00.099161 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:00.099116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:00.551860 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:00.551838    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:00.848199 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:00.848163    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rn82d" event={"ID":"08433406-21df-4003-8a8e-7aae7c0d5632","Type":"ContainerStarted","Data":"ba2a43988124a93b2c4d8c0a186752e4735bb69cc99eaabaff74d209b574b1f8"}
Jul 12 21:53:00.867773 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:00.867727    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rn82d" podStartSLOduration=0.827141157 podStartE2EDuration="2.867688391s" totalImagesPullingTime="2.040547234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:00.867299468 +0000 UTC m=+38.730985980" watchObservedRunningTime="2026-07-12 21:53:00.867688391 +0000 UTC m=+38.731374906"
Jul 12 21:53:01.593821 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:01.593788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:01.800075 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:01.800031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:53:01.800226 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:01.800176    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:53:01.800266 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:01.800240    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls podName:35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef nodeName:}" failed. No retries permitted until 2026-07-12 21:53:05.800225513 +0000 UTC m=+43.663912003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls") pod "dns-default-7b7nt" (UID: "35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef") : secret "dns-default-metrics-tls" not found
Jul 12 21:53:02.266061 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:02.266028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:02.333344 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:02.333309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:02.424287 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:02.424252    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:02.526140 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:02.526061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:05.147111 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.147077    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-r5hhr"]
Jul 12 21:53:05.178996 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.178964    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-r5hhr"]
Jul 12 21:53:05.179135 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.179052    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.183164 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.183057    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 12 21:53:05.183324 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.183205    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 12 21:53:05.184146 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.184120    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kj9dt\""
Jul 12 21:53:05.184146 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.184138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 12 21:53:05.184355 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.184273    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 12 21:53:05.188168 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.188152    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 12 21:53:05.245162 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.245131    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"]
Jul 12 21:53:05.270912 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.270880    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-66bdd8f84-25kc7"]
Jul 12 21:53:05.271049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.270997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:05.275227 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.275200    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 12 21:53:05.275325 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.275259    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z6khv\""
Jul 12 21:53:05.275463 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.275447    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 12 21:53:05.275532 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.275452    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 12 21:53:05.275532 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.275496    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 12 21:53:05.294997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.294977    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"]
Jul 12 21:53:05.295109 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.295004    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66bdd8f84-25kc7"]
Jul 12 21:53:05.295109 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.295072    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.298970 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.298949    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 12 21:53:05.299053 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.299041    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 12 21:53:05.299310 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.299283    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 12 21:53:05.299604 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.299585    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 12 21:53:05.299743 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.299641    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mvs45\""
Jul 12 21:53:05.299804 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.299776    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 12 21:53:05.299866 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.299849    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 12 21:53:05.324299 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.324280    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-tmp\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.324380 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.324305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.324380 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.324329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mghvg\" (UniqueName: \"kubernetes.io/projected/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-kube-api-access-mghvg\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.324380 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.324351    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-snapshots\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.324380 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.324367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.324511 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.324424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-serving-cert\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.349082 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.349059    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"]
Jul 12 21:53:05.371046 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.371026    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"]
Jul 12 21:53:05.371206 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.371172    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"
Jul 12 21:53:05.374667 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.374640    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 12 21:53:05.374785 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.374688    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 12 21:53:05.375012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.374993    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5z8wd\""
Jul 12 21:53:05.375121 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.375033    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:53:05.375186 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.375081    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 12 21:53:05.383112 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.383092    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7498fb8476-vl74l"]
Jul 12 21:53:05.383204 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.383191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:05.385782 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.385767    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 12 21:53:05.386380 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.386363    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:53:05.386511 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.386498    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 12 21:53:05.386557 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.386517    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-49vmr\""
Jul 12 21:53:05.405122 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.405071    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"]
Jul 12 21:53:05.405122 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.405101    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"]
Jul 12 21:53:05.405122 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.405117    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7498fb8476-vl74l"]
Jul 12 21:53:05.405295 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.405197    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.409010 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.408987    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 12 21:53:05.409246 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.409224    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7jvnd\""
Jul 12 21:53:05.409412 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.409393    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 12 21:53:05.410153 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.410131    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 12 21:53:05.416595 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.416570    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 12 21:53:05.425649 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.425630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-snapshots\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.425759 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.425657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.425759 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.425681    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr22t\" (UniqueName: \"kubernetes.io/projected/820b3430-6f46-4561-a1b7-971cc46f68c5-kube-api-access-hr22t\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:05.425759 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.425721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmpdw\" (UniqueName: \"kubernetes.io/projected/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-kube-api-access-kmpdw\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.425759 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.425752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-serving-cert\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.425923 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.425804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/820b3430-6f46-4561-a1b7-971cc46f68c5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:05.425923 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.425826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:05.425923 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.425847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.426022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.425928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-tmp\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.426022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.425948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.426022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.425970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-default-certificate\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.426022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.426000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mghvg\" (UniqueName: \"kubernetes.io/projected/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-kube-api-access-mghvg\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.426233 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.426196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.426233 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.426221    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.426348 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.426237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-stats-auth\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.426348 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.426281    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-tmp\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.426348 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.426340    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-snapshots\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.426807 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.426791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.429238 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.429221    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-serving-cert\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.435135 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.435114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mghvg\" (UniqueName: \"kubernetes.io/projected/41ad5c1e-6fc9-41ca-bddb-df1c0199d59f-kube-api-access-mghvg\") pod \"insights-operator-68d9dd94cf-r5hhr\" (UID: \"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f\") " pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.480731 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.480689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:05.489619 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.489597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr"
Jul 12 21:53:05.527011 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.526986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm89f\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-kube-api-access-sm89f\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.527097 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sthdf\" (UniqueName: \"kubernetes.io/projected/388154e7-6126-499c-b5ca-5454691a1365-kube-api-access-sthdf\") pod \"service-ca-operator-7695fc6c8c-mcn49\" (UID: \"388154e7-6126-499c-b5ca-5454691a1365\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"
Jul 12 21:53:05.527097 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-trusted-ca\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.527097 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-installation-pull-secrets\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.527097 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/820b3430-6f46-4561-a1b7-971cc46f68c5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:05.527298 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527100    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.527298 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-image-registry-private-configuration\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.527298 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-phfd7\" (UID: \"602d30bd-131c-49cf-a82f-d01fb351c753\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:05.527298 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-ca-trust-extracted\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.527298 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.527298 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.527255    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 21:53:05.527298 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-stats-auth\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.527298 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-bound-sa-token\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.527646 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmpdw\" (UniqueName: \"kubernetes.io/projected/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-kube-api-access-kmpdw\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.527646 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr22t\" (UniqueName: \"kubernetes.io/projected/820b3430-6f46-4561-a1b7-971cc46f68c5-kube-api-access-hr22t\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:05.527646 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/388154e7-6126-499c-b5ca-5454691a1365-serving-cert\") pod \"service-ca-operator-7695fc6c8c-mcn49\" (UID: \"388154e7-6126-499c-b5ca-5454691a1365\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"
Jul 12 21:53:05.527646 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.527421    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:06.027398224 +0000 UTC m=+43.891084719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : secret "router-metrics-certs-default" not found
Jul 12 21:53:05.527646 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:05.527646 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.527494    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:06.027475403 +0000 UTC m=+43.891161898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : configmap references non-existent config key: service-ca.crt
Jul 12 21:53:05.527646 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.527551    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:05.527646 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.527600    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls podName:820b3430-6f46-4561-a1b7-971cc46f68c5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:06.027587663 +0000 UTC m=+43.891274158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lpwfb" (UID: "820b3430-6f46-4561-a1b7-971cc46f68c5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:05.527646 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/388154e7-6126-499c-b5ca-5454691a1365-config\") pod \"service-ca-operator-7695fc6c8c-mcn49\" (UID: \"388154e7-6126-499c-b5ca-5454691a1365\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"
Jul 12 21:53:05.527646 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb5qj\" (UniqueName: \"kubernetes.io/projected/602d30bd-131c-49cf-a82f-d01fb351c753-kube-api-access-bb5qj\") pod \"cluster-samples-operator-65db858894-phfd7\" (UID: \"602d30bd-131c-49cf-a82f-d01fb351c753\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:05.528131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-default-certificate\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.528131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.528131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527782    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-certificates\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.528131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.527973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/820b3430-6f46-4561-a1b7-971cc46f68c5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:05.529738 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.529715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-stats-auth\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.530128 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.530109    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-default-certificate\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.538287 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.538264    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmpdw\" (UniqueName: \"kubernetes.io/projected/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-kube-api-access-kmpdw\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:05.538430 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.538413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr22t\" (UniqueName: \"kubernetes.io/projected/820b3430-6f46-4561-a1b7-971cc46f68c5-kube-api-access-hr22t\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:05.574885 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.574854    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:05.628513 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.628513 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-certificates\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.628692 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm89f\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-kube-api-access-sm89f\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.628692 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628574    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sthdf\" (UniqueName: \"kubernetes.io/projected/388154e7-6126-499c-b5ca-5454691a1365-kube-api-access-sthdf\") pod \"service-ca-operator-7695fc6c8c-mcn49\" (UID: \"388154e7-6126-499c-b5ca-5454691a1365\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"
Jul 12 21:53:05.628692 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-trusted-ca\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.628692 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-installation-pull-secrets\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.628692 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.628630    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 21:53:05.628692 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.628653    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7498fb8476-vl74l: secret "image-registry-tls" not found
Jul 12 21:53:05.628692 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-image-registry-private-configuration\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.628692 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-phfd7\" (UID: \"602d30bd-131c-49cf-a82f-d01fb351c753\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:05.629078 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.628735    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls podName:d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e nodeName:}" failed. No retries permitted until 2026-07-12 21:53:06.128716557 +0000 UTC m=+43.992403063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls") pod "image-registry-7498fb8476-vl74l" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e") : secret "image-registry-tls" not found
Jul 12 21:53:05.629078 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-ca-trust-extracted\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.629078 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.628782    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 21:53:05.629078 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-bound-sa-token\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.629078 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.628838    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls podName:602d30bd-131c-49cf-a82f-d01fb351c753 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:06.128823722 +0000 UTC m=+43.992510214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls") pod "cluster-samples-operator-65db858894-phfd7" (UID: "602d30bd-131c-49cf-a82f-d01fb351c753") : secret "samples-operator-tls" not found
Jul 12 21:53:05.629078 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/388154e7-6126-499c-b5ca-5454691a1365-serving-cert\") pod \"service-ca-operator-7695fc6c8c-mcn49\" (UID: \"388154e7-6126-499c-b5ca-5454691a1365\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"
Jul 12 21:53:05.629078 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/388154e7-6126-499c-b5ca-5454691a1365-config\") pod \"service-ca-operator-7695fc6c8c-mcn49\" (UID: \"388154e7-6126-499c-b5ca-5454691a1365\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"
Jul 12 21:53:05.629078 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.628993    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5qj\" (UniqueName: \"kubernetes.io/projected/602d30bd-131c-49cf-a82f-d01fb351c753-kube-api-access-bb5qj\") pod \"cluster-samples-operator-65db858894-phfd7\" (UID: \"602d30bd-131c-49cf-a82f-d01fb351c753\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:05.629457 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.629193    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-ca-trust-extracted\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.629457 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.629346    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-certificates\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.629569 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.629540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/388154e7-6126-499c-b5ca-5454691a1365-config\") pod \"service-ca-operator-7695fc6c8c-mcn49\" (UID: \"388154e7-6126-499c-b5ca-5454691a1365\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"
Jul 12 21:53:05.630009 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.629983    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-trusted-ca\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.631576 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.631555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-installation-pull-secrets\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.631672 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.631601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/388154e7-6126-499c-b5ca-5454691a1365-serving-cert\") pod \"service-ca-operator-7695fc6c8c-mcn49\" (UID: \"388154e7-6126-499c-b5ca-5454691a1365\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"
Jul 12 21:53:05.631672 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.631620    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-r5hhr"]
Jul 12 21:53:05.631810 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.631794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-image-registry-private-configuration\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.637970 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.637941    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sthdf\" (UniqueName: \"kubernetes.io/projected/388154e7-6126-499c-b5ca-5454691a1365-kube-api-access-sthdf\") pod \"service-ca-operator-7695fc6c8c-mcn49\" (UID: \"388154e7-6126-499c-b5ca-5454691a1365\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"
Jul 12 21:53:05.638487 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.638470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm89f\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-kube-api-access-sm89f\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.638661 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.638641    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-bound-sa-token\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:05.638926 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.638907    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb5qj\" (UniqueName: \"kubernetes.io/projected/602d30bd-131c-49cf-a82f-d01fb351c753-kube-api-access-bb5qj\") pod \"cluster-samples-operator-65db858894-phfd7\" (UID: \"602d30bd-131c-49cf-a82f-d01fb351c753\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:05.648282 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:05.648259    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ad5c1e_6fc9_41ca_bddb_df1c0199d59f.slice/crio-fb3284da4c2ac1fd5a5b16209d83078726700060cdec29de3f5c70dbb744bcdc WatchSource:0}: Error finding container fb3284da4c2ac1fd5a5b16209d83078726700060cdec29de3f5c70dbb744bcdc: Status 404 returned error can't find the container with id fb3284da4c2ac1fd5a5b16209d83078726700060cdec29de3f5c70dbb744bcdc
Jul 12 21:53:05.681694 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.681649    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"
Jul 12 21:53:05.822220 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.822189    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49"]
Jul 12 21:53:05.827036 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:05.827008    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388154e7_6126_499c_b5ca_5454691a1365.slice/crio-1d3457baa32d2b4c749ada1f6fac7cb95b9d25a46d900af6432acce99aba7728 WatchSource:0}: Error finding container 1d3457baa32d2b4c749ada1f6fac7cb95b9d25a46d900af6432acce99aba7728: Status 404 returned error can't find the container with id 1d3457baa32d2b4c749ada1f6fac7cb95b9d25a46d900af6432acce99aba7728
Jul 12 21:53:05.830478 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.830459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:53:05.830610 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.830592    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:53:05.830666 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:05.830648    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls podName:35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef nodeName:}" failed. No retries permitted until 2026-07-12 21:53:13.830631721 +0000 UTC m=+51.694318215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls") pod "dns-default-7b7nt" (UID: "35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef") : secret "dns-default-metrics-tls" not found
Jul 12 21:53:05.860723 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.860677    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr" event={"ID":"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f","Type":"ContainerStarted","Data":"fb3284da4c2ac1fd5a5b16209d83078726700060cdec29de3f5c70dbb744bcdc"}
Jul 12 21:53:05.861581 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:05.861564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49" event={"ID":"388154e7-6126-499c-b5ca-5454691a1365","Type":"ContainerStarted","Data":"1d3457baa32d2b4c749ada1f6fac7cb95b9d25a46d900af6432acce99aba7728"}
Jul 12 21:53:06.032404 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:06.032322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:06.032404 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:06.032373    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:06.032574 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:06.032485    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 21:53:06.032574 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:06.032520    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:07.032499535 +0000 UTC m=+44.896186046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : configmap references non-existent config key: service-ca.crt
Jul 12 21:53:06.032574 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:06.032540    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:07.032533013 +0000 UTC m=+44.896219505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : secret "router-metrics-certs-default" not found
Jul 12 21:53:06.032574 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:06.032552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:06.032735 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:06.032646    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:06.032735 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:06.032692    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls podName:820b3430-6f46-4561-a1b7-971cc46f68c5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:07.032682747 +0000 UTC m=+44.896369238 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lpwfb" (UID: "820b3430-6f46-4561-a1b7-971cc46f68c5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:06.133957 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:06.133924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-phfd7\" (UID: \"602d30bd-131c-49cf-a82f-d01fb351c753\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:06.134105 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:06.134048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:06.134105 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:06.134076    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 21:53:06.134169 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:06.134131    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls podName:602d30bd-131c-49cf-a82f-d01fb351c753 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:07.134116704 +0000 UTC m=+44.997803196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls") pod "cluster-samples-operator-65db858894-phfd7" (UID: "602d30bd-131c-49cf-a82f-d01fb351c753") : secret "samples-operator-tls" not found
Jul 12 21:53:06.134169 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:06.134151    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 21:53:06.134169 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:06.134162    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7498fb8476-vl74l: secret "image-registry-tls" not found
Jul 12 21:53:06.134261 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:06.134206    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls podName:d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e nodeName:}" failed. No retries permitted until 2026-07-12 21:53:07.134192987 +0000 UTC m=+44.997879482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls") pod "image-registry-7498fb8476-vl74l" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e") : secret "image-registry-tls" not found
Jul 12 21:53:07.041864 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:07.041827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:07.042302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:07.041880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:07.042302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:07.041938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:07.042302 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:07.041992    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 21:53:07.042302 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:07.042053    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:09.042036616 +0000 UTC m=+46.905723109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : configmap references non-existent config key: service-ca.crt
Jul 12 21:53:07.042302 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:07.042074    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:09.042067333 +0000 UTC m=+46.905753826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : secret "router-metrics-certs-default" not found
Jul 12 21:53:07.042302 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:07.042095    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:07.042302 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:07.042148    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls podName:820b3430-6f46-4561-a1b7-971cc46f68c5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:09.042132704 +0000 UTC m=+46.905819210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lpwfb" (UID: "820b3430-6f46-4561-a1b7-971cc46f68c5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:07.142690 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:07.142653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-phfd7\" (UID: \"602d30bd-131c-49cf-a82f-d01fb351c753\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:07.142972 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:07.142809    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 21:53:07.142972 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:07.142823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:07.142972 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:07.142866    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls podName:602d30bd-131c-49cf-a82f-d01fb351c753 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:09.142851123 +0000 UTC m=+47.006537614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls") pod "cluster-samples-operator-65db858894-phfd7" (UID: "602d30bd-131c-49cf-a82f-d01fb351c753") : secret "samples-operator-tls" not found
Jul 12 21:53:07.142972 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:07.142930    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 21:53:07.142972 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:07.142944    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7498fb8476-vl74l: secret "image-registry-tls" not found
Jul 12 21:53:07.143206 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:07.142993    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls podName:d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e nodeName:}" failed. No retries permitted until 2026-07-12 21:53:09.142979154 +0000 UTC m=+47.006665651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls") pod "image-registry-7498fb8476-vl74l" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e") : secret "image-registry-tls" not found
Jul 12 21:53:07.336535 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:07.336503    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:07.785092 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:07.784995    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:07.886858 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:07.886814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:09.059843 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:09.059808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:09.060228 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:09.059866    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:09.060228 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:09.059913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:09.060228 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:09.059982    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 21:53:09.060228 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:09.060047    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:09.060228 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:09.060051    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:13.060032221 +0000 UTC m=+50.923718714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : secret "router-metrics-certs-default" not found
Jul 12 21:53:09.060228 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:09.060070    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:13.060061267 +0000 UTC m=+50.923747761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : configmap references non-existent config key: service-ca.crt
Jul 12 21:53:09.060228 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:09.060084    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls podName:820b3430-6f46-4561-a1b7-971cc46f68c5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:13.060076571 +0000 UTC m=+50.923763072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lpwfb" (UID: "820b3430-6f46-4561-a1b7-971cc46f68c5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:09.160970 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:09.160888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:09.161122 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:09.160966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-phfd7\" (UID: \"602d30bd-131c-49cf-a82f-d01fb351c753\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:09.161122 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:09.161008    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 21:53:09.161122 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:09.161031    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7498fb8476-vl74l: secret "image-registry-tls" not found
Jul 12 21:53:09.161122 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:09.161085    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls podName:d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e nodeName:}" failed. No retries permitted until 2026-07-12 21:53:13.161066392 +0000 UTC m=+51.024752906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls") pod "image-registry-7498fb8476-vl74l" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e") : secret "image-registry-tls" not found
Jul 12 21:53:09.161122 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:09.161105    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 21:53:09.161373 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:09.161159    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls podName:602d30bd-131c-49cf-a82f-d01fb351c753 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:13.161142001 +0000 UTC m=+51.024828492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls") pod "cluster-samples-operator-65db858894-phfd7" (UID: "602d30bd-131c-49cf-a82f-d01fb351c753") : secret "samples-operator-tls" not found
Jul 12 21:53:09.873402 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:09.873367    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49" event={"ID":"388154e7-6126-499c-b5ca-5454691a1365","Type":"ContainerStarted","Data":"0b24e8dcff7148bc7627d0e0babad016ccb6d35a8c1bb912e566bcbe41a7a422"}
Jul 12 21:53:09.874850 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:09.874821    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr" event={"ID":"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f","Type":"ContainerStarted","Data":"5f68fd6260a242feb60007f6990642bc19c2a8f6da98c49fb3ef4589d1ac3941"}
Jul 12 21:53:09.896973 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:09.896901    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49" podStartSLOduration=1.82350466 podStartE2EDuration="4.89688242s" totalImagesPullingTime="3.07337776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:09.894839637 +0000 UTC m=+47.758526148" watchObservedRunningTime="2026-07-12 21:53:09.89688242 +0000 UTC m=+47.760568935"
Jul 12 21:53:09.913204 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:09.913150    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr" podStartSLOduration=1.656380075 podStartE2EDuration="4.913130124s" totalImagesPullingTime="3.256750049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:09.912756958 +0000 UTC m=+47.776443493" watchObservedRunningTime="2026-07-12 21:53:09.913130124 +0000 UTC m=+47.776816638"
Jul 12 21:53:09.983251 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:09.983220    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9mv56"]
Jul 12 21:53:10.005325 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.005297    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9mv56"]
Jul 12 21:53:10.005506 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.005425    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.008241 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.008222    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 12 21:53:10.008374 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.008269    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rwml9\""
Jul 12 21:53:10.008472 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.008458    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 12 21:53:10.027040 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.027009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:10.068972 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.068943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e6cc8ab-ffd4-4203-91e1-366c8592552a-crio-socket\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.069360 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.069006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.069360 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.069146    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flhv4\" (UniqueName: \"kubernetes.io/projected/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-api-access-flhv4\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.069360 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.069197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.069360 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.069247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e6cc8ab-ffd4-4203-91e1-366c8592552a-data-volume\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.100982 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.100953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:10.169947 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.169864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flhv4\" (UniqueName: \"kubernetes.io/projected/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-api-access-flhv4\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.169947 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.169928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.170120 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.169955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e6cc8ab-ffd4-4203-91e1-366c8592552a-data-volume\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.170120 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.169985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e6cc8ab-ffd4-4203-91e1-366c8592552a-crio-socket\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.170120 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:10.170067    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 21:53:10.170262 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:10.170126    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm podName:5e6cc8ab-ffd4-4203-91e1-366c8592552a nodeName:}" failed. No retries permitted until 2026-07-12 21:53:10.670108809 +0000 UTC m=+48.533795302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9mv56" (UID: "5e6cc8ab-ffd4-4203-91e1-366c8592552a") : configmap "kube-rbac-proxy" not found
Jul 12 21:53:10.170262 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.170142    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e6cc8ab-ffd4-4203-91e1-366c8592552a-crio-socket\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.170262 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.170176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.170262 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:10.170246    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:10.170262 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.170257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e6cc8ab-ffd4-4203-91e1-366c8592552a-data-volume\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.170422 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:10.170309    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls podName:5e6cc8ab-ffd4-4203-91e1-366c8592552a nodeName:}" failed. No retries permitted until 2026-07-12 21:53:10.670293393 +0000 UTC m=+48.533979897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9mv56" (UID: "5e6cc8ab-ffd4-4203-91e1-366c8592552a") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:10.181383 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.181357    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flhv4\" (UniqueName: \"kubernetes.io/projected/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-api-access-flhv4\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.363090 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.363059    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:10.449634 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.449555    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:10.548646 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.548615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:10.674822 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.674792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.674963 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.674875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:10.674963 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:10.674903    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 21:53:10.674963 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:10.674957    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm podName:5e6cc8ab-ffd4-4203-91e1-366c8592552a nodeName:}" failed. No retries permitted until 2026-07-12 21:53:11.674942726 +0000 UTC m=+49.538629216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9mv56" (UID: "5e6cc8ab-ffd4-4203-91e1-366c8592552a") : configmap "kube-rbac-proxy" not found
Jul 12 21:53:10.675068 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:10.674966    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:10.675068 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:10.675000    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls podName:5e6cc8ab-ffd4-4203-91e1-366c8592552a nodeName:}" failed. No retries permitted until 2026-07-12 21:53:11.67499027 +0000 UTC m=+49.538676761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9mv56" (UID: "5e6cc8ab-ffd4-4203-91e1-366c8592552a") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:10.805987 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.805919    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:10.926122 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:10.926090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:11.264407 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:11.264372    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:11.361516 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:11.361485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:11.682910 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:11.682873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:11.683064 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:11.682959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:11.683064 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:11.683011    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 21:53:11.683139 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:11.683075    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:11.683139 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:11.683077    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm podName:5e6cc8ab-ffd4-4203-91e1-366c8592552a nodeName:}" failed. No retries permitted until 2026-07-12 21:53:13.683061077 +0000 UTC m=+51.546747568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9mv56" (UID: "5e6cc8ab-ffd4-4203-91e1-366c8592552a") : configmap "kube-rbac-proxy" not found
Jul 12 21:53:11.683139 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:11.683118    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls podName:5e6cc8ab-ffd4-4203-91e1-366c8592552a nodeName:}" failed. No retries permitted until 2026-07-12 21:53:13.683107625 +0000 UTC m=+51.546794115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9mv56" (UID: "5e6cc8ab-ffd4-4203-91e1-366c8592552a") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:11.741953 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:11.741926    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f5c5g_9e22ccf9-a301-4b5a-af20-621e9027b3be/dns-node-resolver/0.log"
Jul 12 21:53:12.445022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:12.444990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:12.512237 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:12.512208    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:12.699390 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:12.699319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:12.797985 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:12.797953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:12.941803 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:12.941776    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ns7fs_2ccdf2e0-1700-429b-8198-0861386af90b/node-ca/0.log"
Jul 12 21:53:13.093884 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:13.093857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:13.094049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:13.093918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:13.094049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:13.093978    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:13.094049 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.094002    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 21:53:13.094049 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.094030    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:21.094015233 +0000 UTC m=+58.957701723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : configmap references non-existent config key: service-ca.crt
Jul 12 21:53:13.094049 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.094050    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:21.094043365 +0000 UTC m=+58.957729856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : secret "router-metrics-certs-default" not found
Jul 12 21:53:13.094256 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.094077    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:13.094256 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.094114    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls podName:820b3430-6f46-4561-a1b7-971cc46f68c5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:21.094103485 +0000 UTC m=+58.957789975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lpwfb" (UID: "820b3430-6f46-4561-a1b7-971cc46f68c5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:13.194782 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:13.194745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-phfd7\" (UID: \"602d30bd-131c-49cf-a82f-d01fb351c753\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:13.194942 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.194885    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 12 21:53:13.194981 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.194950    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls podName:602d30bd-131c-49cf-a82f-d01fb351c753 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:21.194934117 +0000 UTC m=+59.058620618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls") pod "cluster-samples-operator-65db858894-phfd7" (UID: "602d30bd-131c-49cf-a82f-d01fb351c753") : secret "samples-operator-tls" not found
Jul 12 21:53:13.195021 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:13.194986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:13.195092 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.195081    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 12 21:53:13.195124 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.195094    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7498fb8476-vl74l: secret "image-registry-tls" not found
Jul 12 21:53:13.195155 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.195126    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls podName:d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e nodeName:}" failed. No retries permitted until 2026-07-12 21:53:21.195118489 +0000 UTC m=+59.058804979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls") pod "image-registry-7498fb8476-vl74l" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e") : secret "image-registry-tls" not found
Jul 12 21:53:13.613936 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:13.613906    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:13.699484 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:13.699456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:13.699626 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:13.699543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:13.699626 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.699561    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:13.699626 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.699606    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 21:53:13.699626 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.699614    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls podName:5e6cc8ab-ffd4-4203-91e1-366c8592552a nodeName:}" failed. No retries permitted until 2026-07-12 21:53:17.699599745 +0000 UTC m=+55.563286236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9mv56" (UID: "5e6cc8ab-ffd4-4203-91e1-366c8592552a") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:13.699777 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.699647    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm podName:5e6cc8ab-ffd4-4203-91e1-366c8592552a nodeName:}" failed. No retries permitted until 2026-07-12 21:53:17.699631226 +0000 UTC m=+55.563317723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9mv56" (UID: "5e6cc8ab-ffd4-4203-91e1-366c8592552a") : configmap "kube-rbac-proxy" not found
Jul 12 21:53:13.744026 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:13.743998    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rn82d_08433406-21df-4003-8a8e-7aae7c0d5632/serve-healthcheck-canary/0.log"
Jul 12 21:53:13.900361 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:13.900293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:53:13.900489 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.900448    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 12 21:53:13.900527 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:13.900504    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls podName:35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef nodeName:}" failed. No retries permitted until 2026-07-12 21:53:29.900489301 +0000 UTC m=+67.764175797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls") pod "dns-default-7b7nt" (UID: "35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef") : secret "dns-default-metrics-tls" not found
Jul 12 21:53:16.523097 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:16.523062    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:16.733882 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:16.733850    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:16.844287 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:16.844258    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:16.940240 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:16.940209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:17.311562 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:17.311481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:17.425880 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:17.425852    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:17.738907 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:17.738871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:17.739341 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:17.738975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:17.739341 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:17.739028    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:17.739341 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:17.739074    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 12 21:53:17.739341 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:17.739097    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls podName:5e6cc8ab-ffd4-4203-91e1-366c8592552a nodeName:}" failed. No retries permitted until 2026-07-12 21:53:25.739074923 +0000 UTC m=+63.602761430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9mv56" (UID: "5e6cc8ab-ffd4-4203-91e1-366c8592552a") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:17.739341 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:17.739122    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm podName:5e6cc8ab-ffd4-4203-91e1-366c8592552a nodeName:}" failed. No retries permitted until 2026-07-12 21:53:25.739106968 +0000 UTC m=+63.602793459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9mv56" (UID: "5e6cc8ab-ffd4-4203-91e1-366c8592552a") : configmap "kube-rbac-proxy" not found
Jul 12 21:53:18.383305 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:18.383272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:18.602118 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:18.602086    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:18.795595 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:18.795517    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:18.974757 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:18.974672    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:19.174646 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:19.174615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:19.547379 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:19.547295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:19.774138 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:19.774109    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:20.103341 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:20.103295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:20.379007 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:20.378934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:20.585908 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:20.585873    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:20.777416 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:20.777336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:20.976854 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:20.976823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:21.078121 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.078042    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:21.166243 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.166209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:21.166664 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.166288    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:21.166664 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.166324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:21.166664 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:21.166373    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:21.166664 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:21.166436    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls podName:820b3430-6f46-4561-a1b7-971cc46f68c5 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:37.166420087 +0000 UTC m=+75.030106578 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lpwfb" (UID: "820b3430-6f46-4561-a1b7-971cc46f68c5") : secret "cluster-monitoring-operator-tls" not found
Jul 12 21:53:21.166664 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:21.166444    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 12 21:53:21.166664 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:21.166503    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:37.166484414 +0000 UTC m=+75.030170910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : secret "router-metrics-certs-default" not found
Jul 12 21:53:21.166664 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:21.166523    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle podName:ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:37.16651268 +0000 UTC m=+75.030199170 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle") pod "router-default-66bdd8f84-25kc7" (UID: "ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542") : configmap references non-existent config key: service-ca.crt
Jul 12 21:53:21.179487 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.179464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:21.267167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.267132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:21.267312 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.267219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-phfd7\" (UID: \"602d30bd-131c-49cf-a82f-d01fb351c753\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:21.269570 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.269541    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls\") pod \"image-registry-7498fb8476-vl74l\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") " pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:21.269691 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.269572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/602d30bd-131c-49cf-a82f-d01fb351c753-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-phfd7\" (UID: \"602d30bd-131c-49cf-a82f-d01fb351c753\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:21.291477 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.291443    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"
Jul 12 21:53:21.313424 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.313387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:21.426299 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.426267    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7"]
Jul 12 21:53:21.449479 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.449235    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7498fb8476-vl74l"]
Jul 12 21:53:21.452922 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:21.452899    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d7a0b5_5327_4e2d_a481_5b9fd9b4504e.slice/crio-1e1a16d247be7a0fbeb13ce6b83546ce79242a38cd90febd7bd70345f4a4b6d2 WatchSource:0}: Error finding container 1e1a16d247be7a0fbeb13ce6b83546ce79242a38cd90febd7bd70345f4a4b6d2: Status 404 returned error can't find the container with id 1e1a16d247be7a0fbeb13ce6b83546ce79242a38cd90febd7bd70345f4a4b6d2
Jul 12 21:53:21.906160 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.906127    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7498fb8476-vl74l" event={"ID":"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e","Type":"ContainerStarted","Data":"9d264bb164ea2a5c301bc34f831cd734e1d617785cbdae03d3580d177375a5d2"}
Jul 12 21:53:21.906361 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.906184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7498fb8476-vl74l" event={"ID":"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e","Type":"ContainerStarted","Data":"1e1a16d247be7a0fbeb13ce6b83546ce79242a38cd90febd7bd70345f4a4b6d2"}
Jul 12 21:53:21.906361 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.906239    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:21.907264 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.907241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7" event={"ID":"602d30bd-131c-49cf-a82f-d01fb351c753","Type":"ContainerStarted","Data":"4e93fc504717be973d0457168482501a80338e1efe5f1ae6bf26335e96ca5422"}
Jul 12 21:53:21.927261 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:21.927214    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7498fb8476-vl74l" podStartSLOduration=16.927198305 podStartE2EDuration="16.927198305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:21.926409303 +0000 UTC m=+59.790095816" watchObservedRunningTime="2026-07-12 21:53:21.927198305 +0000 UTC m=+59.790884833"
Jul 12 21:53:22.413486 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:22.413449    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:22.614810 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:22.614781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:22.794961 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:22.794875    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:22.822873 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:22.822848    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zwgn8"
Jul 12 21:53:22.986732 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:22.986682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:23.187186 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:23.187144    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:23.395626 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:23.395591    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:23.914884 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:23.914855    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7" event={"ID":"602d30bd-131c-49cf-a82f-d01fb351c753","Type":"ContainerStarted","Data":"d0b436a02afff3fc1a773424f751d37ae623942daf8bdf19c381d823445d01fc"}
Jul 12 21:53:23.915257 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:23.914905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7" event={"ID":"602d30bd-131c-49cf-a82f-d01fb351c753","Type":"ContainerStarted","Data":"e3822d90c979430f037f84cbc0e028149c7306de701d51df5c0ed4c2cd7241ef"}
Jul 12 21:53:24.150178 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:24.150153    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:24.391910 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:24.391883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:24.584635 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:24.584602    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:24.786667 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:24.786637    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:24.979594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:24.979514    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:25.174688 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:25.174658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:25.811428 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:25.811392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:25.811642 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:25.811481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:25.811642 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:25.811571    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:25.811642 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:25.811629    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls podName:5e6cc8ab-ffd4-4203-91e1-366c8592552a nodeName:}" failed. No retries permitted until 2026-07-12 21:53:41.811610999 +0000 UTC m=+79.675297490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9mv56" (UID: "5e6cc8ab-ffd4-4203-91e1-366c8592552a") : secret "insights-runtime-extractor-tls" not found
Jul 12 21:53:25.812037 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:25.812012    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e6cc8ab-ffd4-4203-91e1-366c8592552a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:25.980974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:25.980937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:26.585342 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:26.585309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:26.778723 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:26.778683    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:26.989152 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:26.989075    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:27.184884 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:27.184852    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:27.936182 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:27.936149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:28.037664 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.037632    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:28.096223 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.096195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:28.235786 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.235689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:28.436024 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.435995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:53:28.436187 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.436046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:53:28.439277 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.439260    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 12 21:53:28.440476 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.440460    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 12 21:53:28.448878 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.448852    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4a3f48-6604-492c-aa9a-a67a90d378d3-metrics-certs\") pod \"network-metrics-daemon-q4z7k\" (UID: \"6d4a3f48-6604-492c-aa9a-a67a90d378d3\") " pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:53:28.448878 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.448860    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c5451bb-36cd-45ae-ae95-e7f841df4914-original-pull-secret\") pod \"global-pull-secret-syncer-9z5k9\" (UID: \"7c5451bb-36cd-45ae-ae95-e7f841df4914\") " pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:53:28.537464 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.537368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzvj\" (UniqueName: \"kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj\") pod \"network-check-target-n9pdg\" (UID: \"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7\") " pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:53:28.541124 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.541101    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 12 21:53:28.551449 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.551425    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 12 21:53:28.560293 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.560266    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mzvj\" (UniqueName: \"kubernetes.io/projected/83fe65a5-b6cb-4d8a-ac28-84ddb1759da7-kube-api-access-8mzvj\") pod \"network-check-target-n9pdg\" (UID: \"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7\") " pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:53:28.619239 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.619214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:28.676163 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.676141    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4x2vl\""
Jul 12 21:53:28.678200 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.678183    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9z5k9"
Jul 12 21:53:28.680952 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.680920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:28.683763 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.683746    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q4z7k"
Jul 12 21:53:28.685152 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.685132    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j98hn\""
Jul 12 21:53:28.693358 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.693341    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:53:28.818844 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.818756    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-phfd7" podStartSLOduration=21.58252994 podStartE2EDuration="23.818734558s" totalImagesPullingTime="2.236204618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:23.938836087 +0000 UTC m=+61.802522600" watchObservedRunningTime="2026-07-12 21:53:28.818734558 +0000 UTC m=+66.682421075"
Jul 12 21:53:28.819044 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.818988    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9z5k9"]
Jul 12 21:53:28.824507 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:28.824484    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5451bb_36cd_45ae_ae95_e7f841df4914.slice/crio-7bd35f3671f11e5c679ec79127c2300d8715eecf2ec69dd8b4e51ed17570040c WatchSource:0}: Error finding container 7bd35f3671f11e5c679ec79127c2300d8715eecf2ec69dd8b4e51ed17570040c: Status 404 returned error can't find the container with id 7bd35f3671f11e5c679ec79127c2300d8715eecf2ec69dd8b4e51ed17570040c
Jul 12 21:53:28.842586 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.842563    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:28.931101 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.931074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9z5k9" event={"ID":"7c5451bb-36cd-45ae-ae95-e7f841df4914","Type":"ContainerStarted","Data":"7bd35f3671f11e5c679ec79127c2300d8715eecf2ec69dd8b4e51ed17570040c"}
Jul 12 21:53:28.947590 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:28.947562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:29.041138 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:29.041118    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q4z7k"]
Jul 12 21:53:29.043984 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:29.043956    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n9pdg"]
Jul 12 21:53:29.044119 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:29.044026    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4a3f48_6604_492c_aa9a_a67a90d378d3.slice/crio-ac4f8c0ae1700e8513b7c441a277751516b2684abeaa2223b9fce0b85cad42ac WatchSource:0}: Error finding container ac4f8c0ae1700e8513b7c441a277751516b2684abeaa2223b9fce0b85cad42ac: Status 404 returned error can't find the container with id ac4f8c0ae1700e8513b7c441a277751516b2684abeaa2223b9fce0b85cad42ac
Jul 12 21:53:29.046323 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:29.046301    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83fe65a5_b6cb_4d8a_ac28_84ddb1759da7.slice/crio-d3ce8a4fba5103b1ed8562b3dd25f7fe95644073f9074e42093995d7ef22e1eb WatchSource:0}: Error finding container d3ce8a4fba5103b1ed8562b3dd25f7fe95644073f9074e42093995d7ef22e1eb: Status 404 returned error can't find the container with id d3ce8a4fba5103b1ed8562b3dd25f7fe95644073f9074e42093995d7ef22e1eb
Jul 12 21:53:29.253467 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:29.253426    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:29.324629 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:29.324602    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:29.833464 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:29.833415    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:29.936464 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:29.936396    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9pdg" event={"ID":"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7","Type":"ContainerStarted","Data":"d3ce8a4fba5103b1ed8562b3dd25f7fe95644073f9074e42093995d7ef22e1eb"}
Jul 12 21:53:29.938182 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:29.938143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4z7k" event={"ID":"6d4a3f48-6604-492c-aa9a-a67a90d378d3","Type":"ContainerStarted","Data":"ac4f8c0ae1700e8513b7c441a277751516b2684abeaa2223b9fce0b85cad42ac"}
Jul 12 21:53:29.949710 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:29.949660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:53:29.952493 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:29.952469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef-metrics-tls\") pod \"dns-default-7b7nt\" (UID: \"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef\") " pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:53:30.039177 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:30.039066    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:30.144322 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:30.144057    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6dkr4\""
Jul 12 21:53:30.151674 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:30.151446    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:53:30.400228 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:30.400139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:30.476555 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:30.476519    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7b7nt"]
Jul 12 21:53:30.480274 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:30.480241    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c464fc_1ba7_4f96_9cb2_67c2c62fb0ef.slice/crio-4912e592c5e8a8d47356e9aa7920b92a7651e424c1c03582f05f2ec3aaff76eb WatchSource:0}: Error finding container 4912e592c5e8a8d47356e9aa7920b92a7651e424c1c03582f05f2ec3aaff76eb: Status 404 returned error can't find the container with id 4912e592c5e8a8d47356e9aa7920b92a7651e424c1c03582f05f2ec3aaff76eb
Jul 12 21:53:30.877277 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:30.877243    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:30.944861 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:30.944830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7b7nt" event={"ID":"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef","Type":"ContainerStarted","Data":"4912e592c5e8a8d47356e9aa7920b92a7651e424c1c03582f05f2ec3aaff76eb"}
Jul 12 21:53:30.947167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:30.947138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4z7k" event={"ID":"6d4a3f48-6604-492c-aa9a-a67a90d378d3","Type":"ContainerStarted","Data":"5eb9d730a52b228498aaf39aa11ac2ede45cf3da9750ea74d8e1d86a120a4b54"}
Jul 12 21:53:30.977297 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:30.977268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:31.953504 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:31.953457    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q4z7k" event={"ID":"6d4a3f48-6604-492c-aa9a-a67a90d378d3","Type":"ContainerStarted","Data":"db3e4cc725261db80f78672046d50bc1845cc805d8b0feb1dae8103a268b634d"}
Jul 12 21:53:32.262644 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:32.262561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:32.326299 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:32.326235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:34.967115 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:34.967076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7b7nt" event={"ID":"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef","Type":"ContainerStarted","Data":"3fdd8ee037a218fdf456b402f40266770940bb772aa5e16f30f206b73597c2d2"}
Jul 12 21:53:34.967483 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:34.967147    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7b7nt" event={"ID":"35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef","Type":"ContainerStarted","Data":"36f3569d2e33529e675d1b9d7782d59867c9b17a5ae9a601ffb985f9445cd782"}
Jul 12 21:53:34.967483 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:34.967217    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:53:34.968648 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:34.968621    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9z5k9" event={"ID":"7c5451bb-36cd-45ae-ae95-e7f841df4914","Type":"ContainerStarted","Data":"dabe582fe9b75596cb59c5034ee5cbae75f770267b35de3cd8d68af637906aa2"}
Jul 12 21:53:34.970049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:34.970028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n9pdg" event={"ID":"83fe65a5-b6cb-4d8a-ac28-84ddb1759da7","Type":"ContainerStarted","Data":"25435ab928c572ece7c49b326fd65d6ae0b6b9c9015973d25798b10cfd2710c4"}
Jul 12 21:53:34.970169 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:34.970156    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:53:34.986163 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:34.986108    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q4z7k" podStartSLOduration=71.347010308 podStartE2EDuration="1m12.986090799s" totalImagesPullingTime="1.639080491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:31.980570646 +0000 UTC m=+69.844257159" watchObservedRunningTime="2026-07-12 21:53:34.986090799 +0000 UTC m=+72.849777326"
Jul 12 21:53:34.986523 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:34.986481    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7b7nt" podStartSLOduration=33.236319759 podStartE2EDuration="36.986467988s" totalImagesPullingTime="3.750148229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:34.985923508 +0000 UTC m=+72.849610043" watchObservedRunningTime="2026-07-12 21:53:34.986467988 +0000 UTC m=+72.850154499"
Jul 12 21:53:35.003175 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:35.003135    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9z5k9" podStartSLOduration=67.583342038 podStartE2EDuration="1m13.003122915s" totalImagesPullingTime="5.419780877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:35.00208187 +0000 UTC m=+72.865768380" watchObservedRunningTime="2026-07-12 21:53:35.003122915 +0000 UTC m=+72.866809428"
Jul 12 21:53:35.017991 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:35.017956    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n9pdg" podStartSLOduration=67.836469495 podStartE2EDuration="1m13.017943017s" totalImagesPullingTime="5.181473522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:35.01764867 +0000 UTC m=+72.881335183" watchObservedRunningTime="2026-07-12 21:53:35.017943017 +0000 UTC m=+72.881629529"
Jul 12 21:53:35.837316 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:35.837284    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7498fb8476-vl74l"]
Jul 12 21:53:35.892085 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:35.892054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:35.988068 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:35.988038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:36.091532 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:36.091453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:36.185828 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:36.185800    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:37.213258 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.213224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:37.213608 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.213265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:37.213608 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.213301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:37.213957 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.213930    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-service-ca-bundle\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:37.215584 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.215559    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/820b3430-6f46-4561-a1b7-971cc46f68c5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lpwfb\" (UID: \"820b3430-6f46-4561-a1b7-971cc46f68c5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:37.215762 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.215743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542-metrics-certs\") pod \"router-default-66bdd8f84-25kc7\" (UID: \"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542\") " pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:37.382409 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.382375    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z6khv\""
Jul 12 21:53:37.390390 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.390367    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"
Jul 12 21:53:37.405678 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.405652    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mvs45\""
Jul 12 21:53:37.412931 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.412909    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:37.538943 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.538917    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb"]
Jul 12 21:53:37.542670 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:37.542645    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820b3430_6f46_4561_a1b7_971cc46f68c5.slice/crio-3f4667c12654d9d9bef42c207fde15cd746dcb41e45b689c7c2cfb2de7a18d48 WatchSource:0}: Error finding container 3f4667c12654d9d9bef42c207fde15cd746dcb41e45b689c7c2cfb2de7a18d48: Status 404 returned error can't find the container with id 3f4667c12654d9d9bef42c207fde15cd746dcb41e45b689c7c2cfb2de7a18d48
Jul 12 21:53:37.557548 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.557525    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66bdd8f84-25kc7"]
Jul 12 21:53:37.560183 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:37.560161    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4bd308_4ce9_4f1e_bdb1_47e8a77fb542.slice/crio-4039fe3f1217ad52e8d6298c8aa6f4798743a371e3da686ba984b809058fea2a WatchSource:0}: Error finding container 4039fe3f1217ad52e8d6298c8aa6f4798743a371e3da686ba984b809058fea2a: Status 404 returned error can't find the container with id 4039fe3f1217ad52e8d6298c8aa6f4798743a371e3da686ba984b809058fea2a
Jul 12 21:53:37.982099 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.982060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb" event={"ID":"820b3430-6f46-4561-a1b7-971cc46f68c5","Type":"ContainerStarted","Data":"3f4667c12654d9d9bef42c207fde15cd746dcb41e45b689c7c2cfb2de7a18d48"}
Jul 12 21:53:37.983552 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.983507    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66bdd8f84-25kc7" event={"ID":"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542","Type":"ContainerStarted","Data":"98c4aa7b1d56313e64dab1a1e8a008bc9eae731c00d032fcd00b39e3d2102928"}
Jul 12 21:53:37.983664 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:37.983561    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66bdd8f84-25kc7" event={"ID":"ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542","Type":"ContainerStarted","Data":"4039fe3f1217ad52e8d6298c8aa6f4798743a371e3da686ba984b809058fea2a"}
Jul 12 21:53:38.006224 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:38.006177    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-66bdd8f84-25kc7" podStartSLOduration=33.006160225 podStartE2EDuration="33.006160225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:38.00548608 +0000 UTC m=+75.869172613" watchObservedRunningTime="2026-07-12 21:53:38.006160225 +0000 UTC m=+75.869846735"
Jul 12 21:53:38.413714 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:38.413667    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:38.416281 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:38.416260    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:38.497817 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:38.497782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:38.559068 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:38.559034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:38.986789 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:38.986755    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:38.988172 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:38.988149    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-66bdd8f84-25kc7"
Jul 12 21:53:39.328657 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:39.328617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:39.429999 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:39.429961    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:39.552655 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:39.552576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:39.656609 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:39.656576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:39.730188 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:39.730159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:39.991821 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:39.991782    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb" event={"ID":"820b3430-6f46-4561-a1b7-971cc46f68c5","Type":"ContainerStarted","Data":"9312cd40d2c2413600884e457a3458febd891afdc322db3ce1763b3d1fd159d8"}
Jul 12 21:53:40.010080 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:40.010033    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lpwfb" podStartSLOduration=33.30993599 podStartE2EDuration="35.010014586s" totalImagesPullingTime="1.700078596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:40.009323708 +0000 UTC m=+77.873010243" watchObservedRunningTime="2026-07-12 21:53:40.010014586 +0000 UTC m=+77.873701098"
Jul 12 21:53:40.091654 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:40.091617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:40.458686 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:40.458652    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:40.518930 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:40.518898    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:41.852911 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:41.852880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:41.855253 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:41.855232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e6cc8ab-ffd4-4203-91e1-366c8592552a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mv56\" (UID: \"5e6cc8ab-ffd4-4203-91e1-366c8592552a\") " pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:41.861400 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:41.861375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:41.929422 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:41.929393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:42.117390 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:42.117313    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rwml9\""
Jul 12 21:53:42.125611 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:42.125588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9mv56"
Jul 12 21:53:42.258005 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:42.257877    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9mv56"]
Jul 12 21:53:42.260681 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:42.260646    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e6cc8ab_ffd4_4203_91e1_366c8592552a.slice/crio-0fbd214465e642f6ba0e7a6af89853688f7dc8e628dd8764f19f74a110ad5521 WatchSource:0}: Error finding container 0fbd214465e642f6ba0e7a6af89853688f7dc8e628dd8764f19f74a110ad5521: Status 404 returned error can't find the container with id 0fbd214465e642f6ba0e7a6af89853688f7dc8e628dd8764f19f74a110ad5521
Jul 12 21:53:43.006103 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:43.005977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mv56" event={"ID":"5e6cc8ab-ffd4-4203-91e1-366c8592552a","Type":"ContainerStarted","Data":"0fbd214465e642f6ba0e7a6af89853688f7dc8e628dd8764f19f74a110ad5521"}
Jul 12 21:53:43.251035 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:43.251001    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:43.356038 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:43.355999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:44.977651 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:44.977528    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7b7nt"
Jul 12 21:53:45.453849 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:45.453822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:45.554520 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:45.554465    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:45.742213 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:45.742130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:45.818197 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:45.818166    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:45.842606 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:45.842582    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:53:45.977415 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:45.977385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:46.017801 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:46.017732    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mv56" event={"ID":"5e6cc8ab-ffd4-4203-91e1-366c8592552a","Type":"ContainerStarted","Data":"057c667d6ca9478e235787bec16a2f2571f47e665a099ba50aa3ff542a9d488b"}
Jul 12 21:53:46.298902 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:46.298831    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:46.362587 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:46.362555    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:47.023980 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:47.023943    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mv56" event={"ID":"5e6cc8ab-ffd4-4203-91e1-366c8592552a","Type":"ContainerStarted","Data":"17eb510693c0d47e79feb9dedc8ccdd4b2c819ab5378742b5c1a7a4a80792633"}
Jul 12 21:53:47.125564 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:47.125527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:47.257955 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:47.257849    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:47.359993 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:47.359953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:48.920954 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:48.920934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:49.032297 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:49.032264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mv56" event={"ID":"5e6cc8ab-ffd4-4203-91e1-366c8592552a","Type":"ContainerStarted","Data":"a406f0f7fd0275585e72b4bfa3d1f03b201953e1cea7b3c815a859b6ba62cae9"}
Jul 12 21:53:49.054166 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:49.054111    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9mv56" podStartSLOduration=33.540701227 podStartE2EDuration="40.054095646s" totalImagesPullingTime="6.513394419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 21:53:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:49.051796262 +0000 UTC m=+86.915482792" watchObservedRunningTime="2026-07-12 21:53:49.054095646 +0000 UTC m=+86.917782159"
Jul 12 21:53:50.080739 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:50.080669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:50.181861 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:50.181823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:50.472798 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:50.472760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:50.572803 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:50.572773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:50.909146 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:50.909116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:51.010139 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.010101    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:51.133075 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.133042    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:51.165518 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.165453    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"]
Jul 12 21:53:51.168900 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.168879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.172172 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.172149    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 12 21:53:51.172172 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.172163    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 12 21:53:51.172324 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.172203    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 12 21:53:51.173642 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.173626    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xcjr7\""
Jul 12 21:53:51.188296 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.188274    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"]
Jul 12 21:53:51.195730 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.195692    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"]
Jul 12 21:53:51.198591 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.198577    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.201382 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.201363    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 12 21:53:51.201468 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.201422    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mv4ft\""
Jul 12 21:53:51.201588 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.201573    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 12 21:53:51.207409 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.207391    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 12 21:53:51.212372 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.212354    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tfs7q"]
Jul 12 21:53:51.215421 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.215405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.218088 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.218067    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"]
Jul 12 21:53:51.218487 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.218469    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 12 21:53:51.218536 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.218521    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 12 21:53:51.218842 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.218819    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f6vqh\""
Jul 12 21:53:51.218930 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.218823    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 12 21:53:51.243796 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.243763    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:51.330054 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1dad4548-a102-457d-884d-b394a672b5ec-root\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.330054 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8f76\" (UniqueName: \"kubernetes.io/projected/1dad4548-a102-457d-884d-b394a672b5ec-kube-api-access-d8f76\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.330264 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330091    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.330264 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.330264 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330141    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2pws\" (UniqueName: \"kubernetes.io/projected/d9220b34-86e7-47d5-a442-18b147045dc1-kube-api-access-r2pws\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.330264 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-wtmp\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.330264 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330194    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.330264 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dad4548-a102-457d-884d-b394a672b5ec-sys\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.330566 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9220b34-86e7-47d5-a442-18b147045dc1-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.330566 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93e32902-212e-447d-939a-2ae30c8f370c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.330566 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330360    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmb94\" (UniqueName: \"kubernetes.io/projected/93e32902-212e-447d-939a-2ae30c8f370c-kube-api-access-rmb94\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.330566 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e32902-212e-447d-939a-2ae30c8f370c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.330566 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.330566 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-textfile\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.330566 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d9220b34-86e7-47d5-a442-18b147045dc1-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.330566 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330540    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93e32902-212e-447d-939a-2ae30c8f370c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.330855 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-tls\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.330855 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dad4548-a102-457d-884d-b394a672b5ec-metrics-client-ca\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.330855 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.330629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.391499 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.391458    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:51.431842 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.431774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-textfile\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.431842 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.431814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d9220b34-86e7-47d5-a442-18b147045dc1-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.431842 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.431834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93e32902-212e-447d-939a-2ae30c8f370c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.432106 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.431850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-tls\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432106 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.431868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dad4548-a102-457d-884d-b394a672b5ec-metrics-client-ca\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432106 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.431904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.432106 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.431946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1dad4548-a102-457d-884d-b394a672b5ec-root\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432106 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.431975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8f76\" (UniqueName: \"kubernetes.io/projected/1dad4548-a102-457d-884d-b394a672b5ec-kube-api-access-d8f76\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432106 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.432106 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.432106 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2pws\" (UniqueName: \"kubernetes.io/projected/d9220b34-86e7-47d5-a442-18b147045dc1-kube-api-access-r2pws\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.432106 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-wtmp\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432549 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432549 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dad4548-a102-457d-884d-b394a672b5ec-sys\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432549 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9220b34-86e7-47d5-a442-18b147045dc1-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.432549 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-textfile\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432549 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93e32902-212e-447d-939a-2ae30c8f370c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.432549 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d9220b34-86e7-47d5-a442-18b147045dc1-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.432549 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmb94\" (UniqueName: \"kubernetes.io/projected/93e32902-212e-447d-939a-2ae30c8f370c-kube-api-access-rmb94\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.432549 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e32902-212e-447d-939a-2ae30c8f370c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.432549 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432992 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dad4548-a102-457d-884d-b394a672b5ec-sys\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432992 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-wtmp\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432992 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1dad4548-a102-457d-884d-b394a672b5ec-root\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432992 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432876    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-accelerators-collector-config\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.432992 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432876    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.432992 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:51.432968    2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 12 21:53:51.433293 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:51.433023    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e32902-212e-447d-939a-2ae30c8f370c-openshift-state-metrics-tls podName:93e32902-212e-447d-939a-2ae30c8f370c nodeName:}" failed. No retries permitted until 2026-07-12 21:53:51.933004108 +0000 UTC m=+89.796690633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/93e32902-212e-447d-939a-2ae30c8f370c-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-qxmt4" (UID: "93e32902-212e-447d-939a-2ae30c8f370c") : secret "openshift-state-metrics-tls" not found
Jul 12 21:53:51.433293 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.433226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dad4548-a102-457d-884d-b394a672b5ec-metrics-client-ca\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.433293 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:51.433266    2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 12 21:53:51.433471 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:51.433315    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-tls podName:d9220b34-86e7-47d5-a442-18b147045dc1 nodeName:}" failed. No retries permitted until 2026-07-12 21:53:51.933298144 +0000 UTC m=+89.796984638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-vfn5g" (UID: "d9220b34-86e7-47d5-a442-18b147045dc1") : secret "kube-state-metrics-tls" not found
Jul 12 21:53:51.433471 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.432605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93e32902-212e-447d-939a-2ae30c8f370c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.433818 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.433798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9220b34-86e7-47d5-a442-18b147045dc1-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.434907 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.434888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-tls\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.435221 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.435200    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93e32902-212e-447d-939a-2ae30c8f370c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.435265 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.435243    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.435301 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.435275    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dad4548-a102-457d-884d-b394a672b5ec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.446993 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.446964    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmb94\" (UniqueName: \"kubernetes.io/projected/93e32902-212e-447d-939a-2ae30c8f370c-kube-api-access-rmb94\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.447344 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.447327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2pws\" (UniqueName: \"kubernetes.io/projected/d9220b34-86e7-47d5-a442-18b147045dc1-kube-api-access-r2pws\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.447443 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.447424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8f76\" (UniqueName: \"kubernetes.io/projected/1dad4548-a102-457d-884d-b394a672b5ec-kube-api-access-d8f76\") pod \"node-exporter-tfs7q\" (UID: \"1dad4548-a102-457d-884d-b394a672b5ec\") " pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.494869 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.494841    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:51.524941 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.524913    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tfs7q"
Jul 12 21:53:51.537289 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:51.537265    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dad4548_a102_457d_884d_b394a672b5ec.slice/crio-15a413c45bdeb7d702c17f8ca3eecd8de4c276755da9e0164757357c0a801d99 WatchSource:0}: Error finding container 15a413c45bdeb7d702c17f8ca3eecd8de4c276755da9e0164757357c0a801d99: Status 404 returned error can't find the container with id 15a413c45bdeb7d702c17f8ca3eecd8de4c276755da9e0164757357c0a801d99
Jul 12 21:53:51.592838 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.592799    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:51.706206 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.706130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:51.805064 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.805036    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:51.936771 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.936732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e32902-212e-447d-939a-2ae30c8f370c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.936932 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.936831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:51.939540 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.939514    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/93e32902-212e-447d-939a-2ae30c8f370c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qxmt4\" (UID: \"93e32902-212e-447d-939a-2ae30c8f370c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:51.939657 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:51.939589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9220b34-86e7-47d5-a442-18b147045dc1-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-vfn5g\" (UID: \"d9220b34-86e7-47d5-a442-18b147045dc1\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:52.044395 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:52.044301    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tfs7q" event={"ID":"1dad4548-a102-457d-884d-b394a672b5ec","Type":"ContainerStarted","Data":"15a413c45bdeb7d702c17f8ca3eecd8de4c276755da9e0164757357c0a801d99"}
Jul 12 21:53:52.077580 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:52.077543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"
Jul 12 21:53:52.107828 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:52.107797    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"
Jul 12 21:53:52.263301 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:52.263194    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4"]
Jul 12 21:53:52.264255 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:52.264230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:52.283850 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:52.283824    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-vfn5g"]
Jul 12 21:53:52.431293 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:52.431260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:52.469170 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:52.469128    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e32902_212e_447d_939a_2ae30c8f370c.slice/crio-1f893a912922c26cd6170941203fe17ffa2e755db2445077fefaa44ea1db2018 WatchSource:0}: Error finding container 1f893a912922c26cd6170941203fe17ffa2e755db2445077fefaa44ea1db2018: Status 404 returned error can't find the container with id 1f893a912922c26cd6170941203fe17ffa2e755db2445077fefaa44ea1db2018
Jul 12 21:53:52.469825 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:52.469801    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9220b34_86e7_47d5_a442_18b147045dc1.slice/crio-ebf1235f6bb8b37f8e1ebae2eb8afe7df1bea8ce5343277105220ab319684a75 WatchSource:0}: Error finding container ebf1235f6bb8b37f8e1ebae2eb8afe7df1bea8ce5343277105220ab319684a75: Status 404 returned error can't find the container with id ebf1235f6bb8b37f8e1ebae2eb8afe7df1bea8ce5343277105220ab319684a75
Jul 12 21:53:52.709500 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:52.709391    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:53.049858 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:53.049768    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g" event={"ID":"d9220b34-86e7-47d5-a442-18b147045dc1","Type":"ContainerStarted","Data":"ebf1235f6bb8b37f8e1ebae2eb8afe7df1bea8ce5343277105220ab319684a75"}
Jul 12 21:53:53.051910 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:53.051884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4" event={"ID":"93e32902-212e-447d-939a-2ae30c8f370c","Type":"ContainerStarted","Data":"69bb0edb288d43d4ad4940836655f7c0df93cd7f3e067c231e03c3993ad71457"}
Jul 12 21:53:53.052056 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:53.051939    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4" event={"ID":"93e32902-212e-447d-939a-2ae30c8f370c","Type":"ContainerStarted","Data":"bf7d89eef8b712d5f7a77fda9e5b00e7f41e35c926941897fe8667d0f252b3e0"}
Jul 12 21:53:53.052056 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:53.051964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4" event={"ID":"93e32902-212e-447d-939a-2ae30c8f370c","Type":"ContainerStarted","Data":"1f893a912922c26cd6170941203fe17ffa2e755db2445077fefaa44ea1db2018"}
Jul 12 21:53:53.054045 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:53.054018    2581 generic.go:356] "Generic (PLEG): container finished" podID="1dad4548-a102-457d-884d-b394a672b5ec" containerID="3101f2cdc020b62de55a330668266db98f4ef918e65c098f8e2654d02fd1aa72" exitCode=0
Jul 12 21:53:53.054170 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:53.054080    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tfs7q" event={"ID":"1dad4548-a102-457d-884d-b394a672b5ec","Type":"ContainerDied","Data":"3101f2cdc020b62de55a330668266db98f4ef918e65c098f8e2654d02fd1aa72"}
Jul 12 21:53:53.718006 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:53.717925    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:53.816023 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:53.815981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:54.062200 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:54.062166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tfs7q" event={"ID":"1dad4548-a102-457d-884d-b394a672b5ec","Type":"ContainerStarted","Data":"68b2c70203897a81b1224af26da07fe718beca553e0c3e47dfbb15e38580c101"}
Jul 12 21:53:54.062317 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:54.062226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tfs7q" event={"ID":"1dad4548-a102-457d-884d-b394a672b5ec","Type":"ContainerStarted","Data":"c02b02ef40ed9f1c14adbd01993bc4caeeda60aa0851ddaf05d0cdec0023a2fc"}
Jul 12 21:53:54.063891 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:54.063868    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g" event={"ID":"d9220b34-86e7-47d5-a442-18b147045dc1","Type":"ContainerStarted","Data":"2cca52d095cc2103fe5da5edb02364d361dd1dd2118f0b0a36a9e2536ffaf99b"}
Jul 12 21:53:54.066447 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:54.066424    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4" event={"ID":"93e32902-212e-447d-939a-2ae30c8f370c","Type":"ContainerStarted","Data":"e56a705862cb96fe2b7644144c44b52c673601d353f155105e12a6f5007b4805"}
Jul 12 21:53:54.100174 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:54.100128    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tfs7q" podStartSLOduration=2.053963939 podStartE2EDuration="3.100112683s" totalImagesPullingTime="975.718742ms" totalInitContainerRuntime="70.430002ms" isStatefulPod=true podCreationTimestamp="2026-07-12 21:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:54.099101603 +0000 UTC m=+91.962788116" watchObservedRunningTime="2026-07-12 21:53:54.100112683 +0000 UTC m=+91.963799196"
Jul 12 21:53:54.175456 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:54.175404    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qxmt4" podStartSLOduration=1.808328285 podStartE2EDuration="3.175386747s" totalImagesPullingTime="1.367058462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:54.159240857 +0000 UTC m=+92.022927371" watchObservedRunningTime="2026-07-12 21:53:54.175386747 +0000 UTC m=+92.039073261"
Jul 12 21:53:54.403645 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:54.403605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:54.472028 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:54.471996    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:54.665444 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:54.665363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:54.760827 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:54.760794    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:55.072274 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.072191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g" event={"ID":"d9220b34-86e7-47d5-a442-18b147045dc1","Type":"ContainerStarted","Data":"60e74b87114d28bfc7d12c7def91d24a2003d43a7ff28f28231a0eb0f285316c"}
Jul 12 21:53:55.072274 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.072251    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g" event={"ID":"d9220b34-86e7-47d5-a442-18b147045dc1","Type":"ContainerStarted","Data":"a49d4ce5fd7e0e78829c6e5998d6c146da78aba9b28d810a961383279c275781"}
Jul 12 21:53:55.108098 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.108049    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-vfn5g" podStartSLOduration=2.594806208 podStartE2EDuration="4.108034612s" totalImagesPullingTime="1.513228404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:55.105446516 +0000 UTC m=+92.969133029" watchObservedRunningTime="2026-07-12 21:53:55.108034612 +0000 UTC m=+92.971721124"
Jul 12 21:53:55.320396 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.320365    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:55.385134 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.385102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:55.944139 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.944111    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"]
Jul 12 21:53:55.948817 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.948798    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"
Jul 12 21:53:55.951542 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.951512    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 12 21:53:55.951542 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.951520    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nptsn\""
Jul 12 21:53:55.957380 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.957333    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:55.958080 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.958062    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"]
Jul 12 21:53:55.969090 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.969018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4rf9\" (UniqueName: \"kubernetes.io/projected/a9592871-98d5-46d3-8135-7c78e2165a9e-kube-api-access-r4rf9\") pod \"monitoring-plugin-5f68df7f58-cdb4l\" (UID: \"a9592871-98d5-46d3-8135-7c78e2165a9e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"
Jul 12 21:53:55.969225 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:55.969136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9592871-98d5-46d3-8135-7c78e2165a9e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cdb4l\" (UID: \"a9592871-98d5-46d3-8135-7c78e2165a9e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"
Jul 12 21:53:56.036537 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.036506    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:56.069711 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.069673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9592871-98d5-46d3-8135-7c78e2165a9e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cdb4l\" (UID: \"a9592871-98d5-46d3-8135-7c78e2165a9e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"
Jul 12 21:53:56.069869 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.069737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4rf9\" (UniqueName: \"kubernetes.io/projected/a9592871-98d5-46d3-8135-7c78e2165a9e-kube-api-access-r4rf9\") pod \"monitoring-plugin-5f68df7f58-cdb4l\" (UID: \"a9592871-98d5-46d3-8135-7c78e2165a9e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"
Jul 12 21:53:56.069869 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:56.069812    2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 12 21:53:56.069980 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:53:56.069874    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9592871-98d5-46d3-8135-7c78e2165a9e-monitoring-plugin-cert podName:a9592871-98d5-46d3-8135-7c78e2165a9e nodeName:}" failed. No retries permitted until 2026-07-12 21:53:56.569856381 +0000 UTC m=+94.433542871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a9592871-98d5-46d3-8135-7c78e2165a9e-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-cdb4l" (UID: "a9592871-98d5-46d3-8135-7c78e2165a9e") : secret "monitoring-plugin-cert" not found
Jul 12 21:53:56.078796 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.078770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4rf9\" (UniqueName: \"kubernetes.io/projected/a9592871-98d5-46d3-8135-7c78e2165a9e-kube-api-access-r4rf9\") pod \"monitoring-plugin-5f68df7f58-cdb4l\" (UID: \"a9592871-98d5-46d3-8135-7c78e2165a9e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"
Jul 12 21:53:56.258566 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.258490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:56.321541 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.321508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:56.493166 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.493137    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:56.573507 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.573426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9592871-98d5-46d3-8135-7c78e2165a9e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cdb4l\" (UID: \"a9592871-98d5-46d3-8135-7c78e2165a9e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"
Jul 12 21:53:56.575742 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.575713    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9592871-98d5-46d3-8135-7c78e2165a9e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cdb4l\" (UID: \"a9592871-98d5-46d3-8135-7c78e2165a9e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"
Jul 12 21:53:56.857818 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.857783    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"
Jul 12 21:53:56.924809 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.924750    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:56.989284 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.989251    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"]
Jul 12 21:53:56.991892 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:56.991864    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9592871_98d5_46d3_8135_7c78e2165a9e.slice/crio-5bc0aeeef637372fc62ba2ba1be9519ae19f771fe9a154ce1666ac954c5388d0 WatchSource:0}: Error finding container 5bc0aeeef637372fc62ba2ba1be9519ae19f771fe9a154ce1666ac954c5388d0: Status 404 returned error can't find the container with id 5bc0aeeef637372fc62ba2ba1be9519ae19f771fe9a154ce1666ac954c5388d0
Jul 12 21:53:56.992178 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:56.992155    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:57.080018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.079984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l" event={"ID":"a9592871-98d5-46d3-8135-7c78e2165a9e","Type":"ContainerStarted","Data":"5bc0aeeef637372fc62ba2ba1be9519ae19f771fe9a154ce1666ac954c5388d0"}
Jul 12 21:53:57.613361 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.613248    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 21:53:57.616876 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.616837    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:57.618832 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.618810    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.621671 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.621651    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 12 21:53:57.621835 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.621806    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 12 21:53:57.621929 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.621908    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 12 21:53:57.622026 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.621919    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 12 21:53:57.622174 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.622118    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 12 21:53:57.622328 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.622308    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 12 21:53:57.623203 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.623187    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3nlftlrdg819c\""
Jul 12 21:53:57.623305 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.623224    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hkztc\""
Jul 12 21:53:57.623305 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.623233    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 12 21:53:57.623417 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.623357    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 12 21:53:57.623417 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.623383    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 12 21:53:57.623518 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.623450    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 12 21:53:57.623518 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.623493    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 12 21:53:57.623619 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.623574    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 12 21:53:57.623619 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.623578    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 12 21:53:57.623841 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.623818    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 12 21:53:57.625752 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.625734    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 12 21:53:57.631690 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.631668    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 21:53:57.681302 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681440 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-web-config\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681440 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681374    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681440 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681421    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681614 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681470    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681614 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681503    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681614 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681614 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681614 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681613    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681894 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681894 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681894 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681894 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config-out\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681894 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681894 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681894 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681894 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzcn9\" (UniqueName: \"kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-kube-api-access-zzcn9\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.681894 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.682299 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.682299 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.681969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.782985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783203 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783203 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783203 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783203 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783100    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783203 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config-out\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783203 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783203 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783203 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzcn9\" (UniqueName: \"kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-kube-api-access-zzcn9\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-web-config\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.783594 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.784137 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.783831    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.784570 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.784538    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.784719 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.784670    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.786268 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.785631    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.786268 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.785972    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.786613 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.786568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.786613 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.786609    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.787099 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.786806    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.787099 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.786909    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config-out\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.787259 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.787142    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.787259 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.787238    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.788102 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.788075    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.788831 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.788664    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.788976 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.788779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.790193 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.789790    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-web-config\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.790193 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.790111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.790193 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.790154    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.790468 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.790449    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.790524 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.790489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.799885 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.799864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzcn9\" (UniqueName: \"kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-kube-api-access-zzcn9\") pod \"prometheus-k8s-0\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:57.879731 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.879629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:57.931669 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:57.931617    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:53:58.380138 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:58.380108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:58.403820 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:58.403783    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 21:53:58.407253 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:53:58.407231    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f31e37_82e7_4fe2_8d9a_8732a0194ea4.slice/crio-d1a74b7506f44566fb37613074fcf14feb45ed810000dd716832de928a11c29a WatchSource:0}: Error finding container d1a74b7506f44566fb37613074fcf14feb45ed810000dd716832de928a11c29a: Status 404 returned error can't find the container with id d1a74b7506f44566fb37613074fcf14feb45ed810000dd716832de928a11c29a
Jul 12 21:53:58.473145 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:58.473119    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:53:59.090508 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:59.090466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l" event={"ID":"a9592871-98d5-46d3-8135-7c78e2165a9e","Type":"ContainerStarted","Data":"ff6d276760ad6a24aba764b5a483eba2d877f1829301adfbb9da35ff33235a6d"}
Jul 12 21:53:59.090688 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:59.090637    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"
Jul 12 21:53:59.092081 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:59.092057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerStarted","Data":"d1a74b7506f44566fb37613074fcf14feb45ed810000dd716832de928a11c29a"}
Jul 12 21:53:59.097616 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:59.097596    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l"
Jul 12 21:53:59.107845 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:53:59.107793    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cdb4l" podStartSLOduration=2.783523053 podStartE2EDuration="4.107776517s" totalImagesPullingTime="1.324253464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:53:59.10702837 +0000 UTC m=+96.970714885" watchObservedRunningTime="2026-07-12 21:53:59.107776517 +0000 UTC m=+96.971463031"
Jul 12 21:54:00.096883 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:00.096852    2581 generic.go:356] "Generic (PLEG): container finished" podID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerID="8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339" exitCode=0
Jul 12 21:54:00.097273 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:00.096933    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerDied","Data":"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"}
Jul 12 21:54:00.857653 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:00.857609    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7498fb8476-vl74l" podUID="d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" containerName="registry" containerID="cri-o://9d264bb164ea2a5c301bc34f831cd734e1d617785cbdae03d3580d177375a5d2" gracePeriod=30
Jul 12 21:54:01.103409 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.103362    2581 generic.go:356] "Generic (PLEG): container finished" podID="d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" containerID="9d264bb164ea2a5c301bc34f831cd734e1d617785cbdae03d3580d177375a5d2" exitCode=0
Jul 12 21:54:01.103795 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.103428    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7498fb8476-vl74l" event={"ID":"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e","Type":"ContainerDied","Data":"9d264bb164ea2a5c301bc34f831cd734e1d617785cbdae03d3580d177375a5d2"}
Jul 12 21:54:01.120171 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.120138    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:54:01.214463 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.214425    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-installation-pull-secrets\") pod \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") "
Jul 12 21:54:01.214647 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.214508    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm89f\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-kube-api-access-sm89f\") pod \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") "
Jul 12 21:54:01.214647 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.214526    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-trusted-ca\") pod \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") "
Jul 12 21:54:01.214647 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.214589    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-image-registry-private-configuration\") pod \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") "
Jul 12 21:54:01.214647 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.214619    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-bound-sa-token\") pod \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") "
Jul 12 21:54:01.214647 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.214646    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-ca-trust-extracted\") pod \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") "
Jul 12 21:54:01.214943 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.214670    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls\") pod \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") "
Jul 12 21:54:01.214943 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.214720    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-certificates\") pod \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\" (UID: \"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e\") "
Jul 12 21:54:01.215181 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.215046    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:54:01.215264 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.215233    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:54:01.218496 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.218181    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:54:01.218496 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.218191    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:54:01.218496 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.218327    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:54:01.218496 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.218409    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:54:01.218865 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.218843    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-kube-api-access-sm89f" (OuterVolumeSpecName: "kube-api-access-sm89f") pod "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e"). InnerVolumeSpecName "kube-api-access-sm89f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:54:01.226685 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.226655    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" (UID: "d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:54:01.315385 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.315298    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-image-registry-private-configuration\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:54:01.315385 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.315332    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-bound-sa-token\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:54:01.315385 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.315342    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-ca-trust-extracted\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:54:01.315385 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.315352    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:54:01.315385 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.315363    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-registry-certificates\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:54:01.315385 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.315376    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-installation-pull-secrets\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:54:01.315385 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.315391    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm89f\" (UniqueName: \"kubernetes.io/projected/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-kube-api-access-sm89f\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:54:01.315888 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:01.315404    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e-trusted-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:54:02.107902 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:02.107869    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7498fb8476-vl74l" event={"ID":"d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e","Type":"ContainerDied","Data":"1e1a16d247be7a0fbeb13ce6b83546ce79242a38cd90febd7bd70345f4a4b6d2"}
Jul 12 21:54:02.107902 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:02.107907    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7498fb8476-vl74l"
Jul 12 21:54:02.108389 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:02.107927    2581 scope.go:117] "RemoveContainer" containerID="9d264bb164ea2a5c301bc34f831cd734e1d617785cbdae03d3580d177375a5d2"
Jul 12 21:54:02.129828 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:02.129802    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7498fb8476-vl74l"]
Jul 12 21:54:02.134244 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:02.134219    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7498fb8476-vl74l"]
Jul 12 21:54:02.265713 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:02.265665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:02.333467 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:02.333436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:02.668938 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:02.668904    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" path="/var/lib/kubelet/pods/d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e/volumes"
Jul 12 21:54:04.123177 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:04.123141    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerStarted","Data":"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"}
Jul 12 21:54:04.123530 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:04.123218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerStarted","Data":"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"}
Jul 12 21:54:05.976726 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:05.976634    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n9pdg"
Jul 12 21:54:06.135759 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:06.135725    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerStarted","Data":"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"}
Jul 12 21:54:06.135927 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:06.135790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerStarted","Data":"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"}
Jul 12 21:54:06.135927 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:06.135817    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerStarted","Data":"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"}
Jul 12 21:54:06.135927 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:06.135842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerStarted","Data":"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"}
Jul 12 21:54:06.165858 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:06.165788    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.0340005310000002 podStartE2EDuration="9.16576784s" totalImagesPullingTime="6.112429709s" totalInitContainerRuntime="19.3376ms" isStatefulPod=false podCreationTimestamp="2026-07-12 21:53:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:54:06.165147618 +0000 UTC m=+104.028834189" watchObservedRunningTime="2026-07-12 21:54:06.16576784 +0000 UTC m=+104.029454354"
Jul 12 21:54:06.699541 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:06.699495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:06.797084 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:06.797050    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:06.851718 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:06.851673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:07.932319 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:07.932282    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:54:08.135011 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:08.134978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:08.201890 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:08.201808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:17.268866 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:17.268830    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:17.349521 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:17.349483    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:23.884361 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:23.884329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:23.987271 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:23.987239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:24.052127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:24.052091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:28.720683 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:28.720648    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:28.834193 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:28.834166    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:32.248408 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:32.248368    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:32.306995 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:32.306964    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:54:35.245526 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:35.245492    2581 generic.go:356] "Generic (PLEG): container finished" podID="388154e7-6126-499c-b5ca-5454691a1365" containerID="0b24e8dcff7148bc7627d0e0babad016ccb6d35a8c1bb912e566bcbe41a7a422" exitCode=0
Jul 12 21:54:35.245932 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:35.245567    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49" event={"ID":"388154e7-6126-499c-b5ca-5454691a1365","Type":"ContainerDied","Data":"0b24e8dcff7148bc7627d0e0babad016ccb6d35a8c1bb912e566bcbe41a7a422"}
Jul 12 21:54:35.245994 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:35.245954    2581 scope.go:117] "RemoveContainer" containerID="0b24e8dcff7148bc7627d0e0babad016ccb6d35a8c1bb912e566bcbe41a7a422"
Jul 12 21:54:35.247175 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:35.247078    2581 generic.go:356] "Generic (PLEG): container finished" podID="41ad5c1e-6fc9-41ca-bddb-df1c0199d59f" containerID="5f68fd6260a242feb60007f6990642bc19c2a8f6da98c49fb3ef4589d1ac3941" exitCode=0
Jul 12 21:54:35.247175 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:35.247113    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr" event={"ID":"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f","Type":"ContainerDied","Data":"5f68fd6260a242feb60007f6990642bc19c2a8f6da98c49fb3ef4589d1ac3941"}
Jul 12 21:54:35.247482 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:35.247460    2581 scope.go:117] "RemoveContainer" containerID="5f68fd6260a242feb60007f6990642bc19c2a8f6da98c49fb3ef4589d1ac3941"
Jul 12 21:54:36.257419 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:36.257382    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-mcn49" event={"ID":"388154e7-6126-499c-b5ca-5454691a1365","Type":"ContainerStarted","Data":"f73b3b73ca4ef186bc6dfcb4cf3feae4571e649cd5322efd7336d48fc8664dcd"}
Jul 12 21:54:36.259198 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:36.259177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-r5hhr" event={"ID":"41ad5c1e-6fc9-41ca-bddb-df1c0199d59f","Type":"ContainerStarted","Data":"5515e216650a8c4e0d5f23590273bb60935b536e7f780196d1621a2f1693b00c"}
Jul 12 21:54:57.932178 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:57.932141    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:54:57.947533 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:57.947510    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:54:58.359189 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:54:58.359162    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:10.569668 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:10.569628    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:55:10.774055 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:10.774020    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:55:15.959722 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:15.959624    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 21:55:15.960127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:15.959998    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="prometheus" containerID="cri-o://f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922" gracePeriod=600
Jul 12 21:55:15.960127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:15.960014    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy-web" containerID="cri-o://8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72" gracePeriod=600
Jul 12 21:55:15.960127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:15.960057    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy" containerID="cri-o://7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f" gracePeriod=600
Jul 12 21:55:15.960311 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:15.960020    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="thanos-sidecar" containerID="cri-o://9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3" gracePeriod=600
Jul 12 21:55:15.960311 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:15.960031    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="config-reloader" containerID="cri-o://c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a" gracePeriod=600
Jul 12 21:55:15.960311 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:15.960024    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c" gracePeriod=600
Jul 12 21:55:16.210586 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.210519    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.318416 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318383    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-0\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.318416 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318421    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-web-config\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.318656 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318447    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-1\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.318656 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318473    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.318656 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318604    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-metrics-client-ca\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.318834 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-tls\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.318834 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318690    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-trusted-ca-bundle\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.318834 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318745    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-tls-assets\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.318834 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318803    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzcn9\" (UniqueName: \"kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-kube-api-access-zzcn9\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318847    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-grpc-tls\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318868    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318894    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-kube-rbac-proxy\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318887    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:55:16.319022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318918    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config-out\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318947    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319022 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.318990    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-db\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.319023    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-2\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.319052    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-serving-certs-ca-bundle\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.319075    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-metrics-client-certs\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.319104    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-kubelet-serving-ca-bundle\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.319135    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-thanos-prometheus-http-client-file\") pod \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\" (UID: \"77f31e37-82e7-4fe2-8d9a-8732a0194ea4\") "
Jul 12 21:55:16.319345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.319262    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:55:16.319345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.319325    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:55:16.319595 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.319430    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.319595 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.319451    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-metrics-client-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.319595 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.319467    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.319948 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.319920    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:55:16.320229 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.320196    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:55:16.320595 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.320573    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:55:16.321152 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.321128    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:55:16.321411 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.321380    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:55:16.321799 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.321772    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 21:55:16.321898 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.321880    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:55:16.321961 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.321925    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:55:16.322310 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.322056    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:55:16.322850 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.322822    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config" (OuterVolumeSpecName: "config") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:55:16.323060 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.323028    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:55:16.323443 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.323423    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:55:16.323855 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.323833    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config-out" (OuterVolumeSpecName: "config-out") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 21:55:16.323980 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.323961    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:55:16.324067 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.324034    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-kube-api-access-zzcn9" (OuterVolumeSpecName: "kube-api-access-zzcn9") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "kube-api-access-zzcn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 21:55:16.324460 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.324443    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:55:16.332049 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.332020    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-web-config" (OuterVolumeSpecName: "web-config") pod "77f31e37-82e7-4fe2-8d9a-8732a0194ea4" (UID: "77f31e37-82e7-4fe2-8d9a-8732a0194ea4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 21:55:16.409676 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409641    2581 generic.go:356] "Generic (PLEG): container finished" podID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerID="a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c" exitCode=0
Jul 12 21:55:16.409676 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409664    2581 generic.go:356] "Generic (PLEG): container finished" podID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerID="7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f" exitCode=0
Jul 12 21:55:16.409676 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409675    2581 generic.go:356] "Generic (PLEG): container finished" podID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerID="8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72" exitCode=0
Jul 12 21:55:16.409676 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409684    2581 generic.go:356] "Generic (PLEG): container finished" podID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerID="9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3" exitCode=0
Jul 12 21:55:16.409974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409692    2581 generic.go:356] "Generic (PLEG): container finished" podID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerID="c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a" exitCode=0
Jul 12 21:55:16.409974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409723    2581 generic.go:356] "Generic (PLEG): container finished" podID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerID="f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922" exitCode=0
Jul 12 21:55:16.409974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409731    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.409974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerDied","Data":"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"}
Jul 12 21:55:16.409974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409869    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerDied","Data":"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"}
Jul 12 21:55:16.409974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409897    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerDied","Data":"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"}
Jul 12 21:55:16.409974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409923    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerDied","Data":"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"}
Jul 12 21:55:16.409974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409940    2581 scope.go:117] "RemoveContainer" containerID="a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"
Jul 12 21:55:16.409974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerDied","Data":"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"}
Jul 12 21:55:16.409974 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerDied","Data":"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"}
Jul 12 21:55:16.410387 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.409995    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"77f31e37-82e7-4fe2-8d9a-8732a0194ea4","Type":"ContainerDied","Data":"d1a74b7506f44566fb37613074fcf14feb45ed810000dd716832de928a11c29a"}
Jul 12 21:55:16.418629 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.418517    2581 scope.go:117] "RemoveContainer" containerID="7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"
Jul 12 21:55:16.420761 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420745    2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-grpc-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.420862 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420764    2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.420862 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420780    2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-kube-rbac-proxy\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.420862 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420795    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-config-out\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.420862 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420810    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.420862 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420824    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-db\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.420862 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420838    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.420862 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420852    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.421131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420865    2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-metrics-client-certs\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.421131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420878    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.421131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420892    2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.421131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420906    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.421131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420947    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-web-config\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.421131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420962    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.421131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420976    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.421131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.420990    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-tls-assets\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.421131 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.421003    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzcn9\" (UniqueName: \"kubernetes.io/projected/77f31e37-82e7-4fe2-8d9a-8732a0194ea4-kube-api-access-zzcn9\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 21:55:16.425960 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.425943    2581 scope.go:117] "RemoveContainer" containerID="8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"
Jul 12 21:55:16.432476 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.432456    2581 scope.go:117] "RemoveContainer" containerID="9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"
Jul 12 21:55:16.438758 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.438737    2581 scope.go:117] "RemoveContainer" containerID="c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"
Jul 12 21:55:16.445065 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.445045    2581 scope.go:117] "RemoveContainer" containerID="f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"
Jul 12 21:55:16.449155 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.449134    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 21:55:16.452587 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.452570    2581 scope.go:117] "RemoveContainer" containerID="8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"
Jul 12 21:55:16.457376 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.457356    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 21:55:16.460124 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.460105    2581 scope.go:117] "RemoveContainer" containerID="a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"
Jul 12 21:55:16.460397 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:55:16.460377    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": container with ID starting with a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c not found: ID does not exist" containerID="a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"
Jul 12 21:55:16.460473 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.460409    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"} err="failed to get container status \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": rpc error: code = NotFound desc = could not find container \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": container with ID starting with a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c not found: ID does not exist"
Jul 12 21:55:16.460473 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.460453    2581 scope.go:117] "RemoveContainer" containerID="7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"
Jul 12 21:55:16.460744 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:55:16.460689    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": container with ID starting with 7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f not found: ID does not exist" containerID="7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"
Jul 12 21:55:16.460744 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.460724    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"} err="failed to get container status \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": rpc error: code = NotFound desc = could not find container \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": container with ID starting with 7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f not found: ID does not exist"
Jul 12 21:55:16.460744 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.460740    2581 scope.go:117] "RemoveContainer" containerID="8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"
Jul 12 21:55:16.460942 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:55:16.460924    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": container with ID starting with 8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72 not found: ID does not exist" containerID="8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"
Jul 12 21:55:16.460981 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.460948    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"} err="failed to get container status \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": rpc error: code = NotFound desc = could not find container \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": container with ID starting with 8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72 not found: ID does not exist"
Jul 12 21:55:16.460981 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.460967    2581 scope.go:117] "RemoveContainer" containerID="9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"
Jul 12 21:55:16.461188 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:55:16.461170    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": container with ID starting with 9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3 not found: ID does not exist" containerID="9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"
Jul 12 21:55:16.461247 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.461195    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"} err="failed to get container status \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": rpc error: code = NotFound desc = could not find container \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": container with ID starting with 9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3 not found: ID does not exist"
Jul 12 21:55:16.461247 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.461215    2581 scope.go:117] "RemoveContainer" containerID="c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"
Jul 12 21:55:16.461437 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:55:16.461423    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": container with ID starting with c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a not found: ID does not exist" containerID="c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"
Jul 12 21:55:16.461474 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.461440    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"} err="failed to get container status \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": rpc error: code = NotFound desc = could not find container \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": container with ID starting with c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a not found: ID does not exist"
Jul 12 21:55:16.461474 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.461456    2581 scope.go:117] "RemoveContainer" containerID="f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"
Jul 12 21:55:16.461675 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:55:16.461657    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": container with ID starting with f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922 not found: ID does not exist" containerID="f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"
Jul 12 21:55:16.461748 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.461681    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"} err="failed to get container status \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": rpc error: code = NotFound desc = could not find container \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": container with ID starting with f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922 not found: ID does not exist"
Jul 12 21:55:16.461840 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.461824    2581 scope.go:117] "RemoveContainer" containerID="8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"
Jul 12 21:55:16.462059 ip-10-0-143-64 kubenswrapper[2581]: E0712 21:55:16.462039    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": container with ID starting with 8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339 not found: ID does not exist" containerID="8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"
Jul 12 21:55:16.462105 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.462064    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"} err="failed to get container status \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": rpc error: code = NotFound desc = could not find container \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": container with ID starting with 8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339 not found: ID does not exist"
Jul 12 21:55:16.462105 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.462079    2581 scope.go:117] "RemoveContainer" containerID="a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"
Jul 12 21:55:16.462273 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.462255    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"} err="failed to get container status \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": rpc error: code = NotFound desc = could not find container \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": container with ID starting with a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c not found: ID does not exist"
Jul 12 21:55:16.462333 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.462275    2581 scope.go:117] "RemoveContainer" containerID="7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"
Jul 12 21:55:16.462482 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.462467    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"} err="failed to get container status \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": rpc error: code = NotFound desc = could not find container \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": container with ID starting with 7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f not found: ID does not exist"
Jul 12 21:55:16.462528 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.462483    2581 scope.go:117] "RemoveContainer" containerID="8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"
Jul 12 21:55:16.462692 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.462672    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"} err="failed to get container status \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": rpc error: code = NotFound desc = could not find container \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": container with ID starting with 8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72 not found: ID does not exist"
Jul 12 21:55:16.462692 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.462691    2581 scope.go:117] "RemoveContainer" containerID="9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"
Jul 12 21:55:16.462901 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.462880    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"} err="failed to get container status \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": rpc error: code = NotFound desc = could not find container \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": container with ID starting with 9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3 not found: ID does not exist"
Jul 12 21:55:16.462967 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.462903    2581 scope.go:117] "RemoveContainer" containerID="c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"
Jul 12 21:55:16.463129 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.463113    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"} err="failed to get container status \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": rpc error: code = NotFound desc = could not find container \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": container with ID starting with c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a not found: ID does not exist"
Jul 12 21:55:16.463171 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.463129    2581 scope.go:117] "RemoveContainer" containerID="f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"
Jul 12 21:55:16.463332 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.463315    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"} err="failed to get container status \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": rpc error: code = NotFound desc = could not find container \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": container with ID starting with f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922 not found: ID does not exist"
Jul 12 21:55:16.463332 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.463333    2581 scope.go:117] "RemoveContainer" containerID="8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"
Jul 12 21:55:16.463542 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.463526    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"} err="failed to get container status \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": rpc error: code = NotFound desc = could not find container \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": container with ID starting with 8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339 not found: ID does not exist"
Jul 12 21:55:16.463612 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.463546    2581 scope.go:117] "RemoveContainer" containerID="a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"
Jul 12 21:55:16.463762 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.463746    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"} err="failed to get container status \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": rpc error: code = NotFound desc = could not find container \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": container with ID starting with a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c not found: ID does not exist"
Jul 12 21:55:16.463814 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.463763    2581 scope.go:117] "RemoveContainer" containerID="7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"
Jul 12 21:55:16.463945 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.463921    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"} err="failed to get container status \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": rpc error: code = NotFound desc = could not find container \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": container with ID starting with 7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f not found: ID does not exist"
Jul 12 21:55:16.463945 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.463937    2581 scope.go:117] "RemoveContainer" containerID="8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"
Jul 12 21:55:16.464101 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.464083    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"} err="failed to get container status \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": rpc error: code = NotFound desc = could not find container \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": container with ID starting with 8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72 not found: ID does not exist"
Jul 12 21:55:16.464164 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.464104    2581 scope.go:117] "RemoveContainer" containerID="9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"
Jul 12 21:55:16.464303 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.464284    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"} err="failed to get container status \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": rpc error: code = NotFound desc = could not find container \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": container with ID starting with 9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3 not found: ID does not exist"
Jul 12 21:55:16.464351 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.464305    2581 scope.go:117] "RemoveContainer" containerID="c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"
Jul 12 21:55:16.464499 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.464480    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"} err="failed to get container status \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": rpc error: code = NotFound desc = could not find container \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": container with ID starting with c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a not found: ID does not exist"
Jul 12 21:55:16.464565 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.464500    2581 scope.go:117] "RemoveContainer" containerID="f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"
Jul 12 21:55:16.464750 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.464728    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"} err="failed to get container status \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": rpc error: code = NotFound desc = could not find container \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": container with ID starting with f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922 not found: ID does not exist"
Jul 12 21:55:16.464823 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.464754    2581 scope.go:117] "RemoveContainer" containerID="8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"
Jul 12 21:55:16.464977 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.464961    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"} err="failed to get container status \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": rpc error: code = NotFound desc = could not find container \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": container with ID starting with 8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339 not found: ID does not exist"
Jul 12 21:55:16.465021 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.464978    2581 scope.go:117] "RemoveContainer" containerID="a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"
Jul 12 21:55:16.465197 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.465177    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"} err="failed to get container status \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": rpc error: code = NotFound desc = could not find container \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": container with ID starting with a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c not found: ID does not exist"
Jul 12 21:55:16.465239 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.465198    2581 scope.go:117] "RemoveContainer" containerID="7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"
Jul 12 21:55:16.465393 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.465378    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"} err="failed to get container status \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": rpc error: code = NotFound desc = could not find container \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": container with ID starting with 7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f not found: ID does not exist"
Jul 12 21:55:16.465434 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.465393    2581 scope.go:117] "RemoveContainer" containerID="8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"
Jul 12 21:55:16.465570 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.465551    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"} err="failed to get container status \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": rpc error: code = NotFound desc = could not find container \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": container with ID starting with 8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72 not found: ID does not exist"
Jul 12 21:55:16.465617 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.465570    2581 scope.go:117] "RemoveContainer" containerID="9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"
Jul 12 21:55:16.465761 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.465742    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"} err="failed to get container status \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": rpc error: code = NotFound desc = could not find container \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": container with ID starting with 9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3 not found: ID does not exist"
Jul 12 21:55:16.465835 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.465763    2581 scope.go:117] "RemoveContainer" containerID="c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"
Jul 12 21:55:16.465977 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.465960    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"} err="failed to get container status \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": rpc error: code = NotFound desc = could not find container \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": container with ID starting with c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a not found: ID does not exist"
Jul 12 21:55:16.466020 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.465978    2581 scope.go:117] "RemoveContainer" containerID="f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"
Jul 12 21:55:16.466172 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.466154    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"} err="failed to get container status \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": rpc error: code = NotFound desc = could not find container \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": container with ID starting with f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922 not found: ID does not exist"
Jul 12 21:55:16.466216 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.466173    2581 scope.go:117] "RemoveContainer" containerID="8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"
Jul 12 21:55:16.466359 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.466341    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"} err="failed to get container status \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": rpc error: code = NotFound desc = could not find container \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": container with ID starting with 8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339 not found: ID does not exist"
Jul 12 21:55:16.466397 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.466360    2581 scope.go:117] "RemoveContainer" containerID="a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"
Jul 12 21:55:16.466546 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.466530    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"} err="failed to get container status \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": rpc error: code = NotFound desc = could not find container \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": container with ID starting with a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c not found: ID does not exist"
Jul 12 21:55:16.466587 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.466547    2581 scope.go:117] "RemoveContainer" containerID="7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"
Jul 12 21:55:16.466741 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.466726    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"} err="failed to get container status \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": rpc error: code = NotFound desc = could not find container \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": container with ID starting with 7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f not found: ID does not exist"
Jul 12 21:55:16.466793 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.466742    2581 scope.go:117] "RemoveContainer" containerID="8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"
Jul 12 21:55:16.466911 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.466892    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"} err="failed to get container status \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": rpc error: code = NotFound desc = could not find container \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": container with ID starting with 8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72 not found: ID does not exist"
Jul 12 21:55:16.466975 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.466914    2581 scope.go:117] "RemoveContainer" containerID="9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"
Jul 12 21:55:16.467097 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.467080    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"} err="failed to get container status \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": rpc error: code = NotFound desc = could not find container \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": container with ID starting with 9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3 not found: ID does not exist"
Jul 12 21:55:16.467139 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.467098    2581 scope.go:117] "RemoveContainer" containerID="c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"
Jul 12 21:55:16.467286 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.467269    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"} err="failed to get container status \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": rpc error: code = NotFound desc = could not find container \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": container with ID starting with c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a not found: ID does not exist"
Jul 12 21:55:16.467324 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.467287    2581 scope.go:117] "RemoveContainer" containerID="f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"
Jul 12 21:55:16.467498 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.467480    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"} err="failed to get container status \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": rpc error: code = NotFound desc = could not find container \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": container with ID starting with f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922 not found: ID does not exist"
Jul 12 21:55:16.467557 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.467499    2581 scope.go:117] "RemoveContainer" containerID="8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"
Jul 12 21:55:16.467774 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.467758    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"} err="failed to get container status \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": rpc error: code = NotFound desc = could not find container \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": container with ID starting with 8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339 not found: ID does not exist"
Jul 12 21:55:16.467835 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.467775    2581 scope.go:117] "RemoveContainer" containerID="a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"
Jul 12 21:55:16.467967 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.467950    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c"} err="failed to get container status \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": rpc error: code = NotFound desc = could not find container \"a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c\": container with ID starting with a4e68b5022555987254c61f946f6aefb1e33acdadddb96190d7bbd9871b3a76c not found: ID does not exist"
Jul 12 21:55:16.468004 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.467967    2581 scope.go:117] "RemoveContainer" containerID="7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"
Jul 12 21:55:16.468177 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.468162    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f"} err="failed to get container status \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": rpc error: code = NotFound desc = could not find container \"7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f\": container with ID starting with 7b98b8b9c215de60cb90cbfaf2f9f4d075cf9344b9789e8f06ed78dc95b1622f not found: ID does not exist"
Jul 12 21:55:16.468219 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.468177    2581 scope.go:117] "RemoveContainer" containerID="8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"
Jul 12 21:55:16.468365 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.468349    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72"} err="failed to get container status \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": rpc error: code = NotFound desc = could not find container \"8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72\": container with ID starting with 8fc05e765c53aa4eb95cc4c3bd73024b4a84ca40eeca8520425101d33fdf7f72 not found: ID does not exist"
Jul 12 21:55:16.468405 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.468365    2581 scope.go:117] "RemoveContainer" containerID="9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"
Jul 12 21:55:16.468587 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.468569    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3"} err="failed to get container status \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": rpc error: code = NotFound desc = could not find container \"9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3\": container with ID starting with 9e93a7b7e2d0720c42cf395a1913ca51164ac78aadde1373e1013a44c609cfc3 not found: ID does not exist"
Jul 12 21:55:16.468634 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.468588    2581 scope.go:117] "RemoveContainer" containerID="c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"
Jul 12 21:55:16.468879 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.468862    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a"} err="failed to get container status \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": rpc error: code = NotFound desc = could not find container \"c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a\": container with ID starting with c585b63dc08e688f4dc24d6dba8fc4107cbad24b446720fb7e4baadcd3a11f9a not found: ID does not exist"
Jul 12 21:55:16.468928 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.468879    2581 scope.go:117] "RemoveContainer" containerID="f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"
Jul 12 21:55:16.469053 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.469038    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922"} err="failed to get container status \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": rpc error: code = NotFound desc = could not find container \"f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922\": container with ID starting with f4c49ec15f0f18bd74f2780844cc0b6900aef3aca3305b2d0ac046efbe67b922 not found: ID does not exist"
Jul 12 21:55:16.469096 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.469053    2581 scope.go:117] "RemoveContainer" containerID="8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"
Jul 12 21:55:16.469252 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.469234    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339"} err="failed to get container status \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": rpc error: code = NotFound desc = could not find container \"8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339\": container with ID starting with 8768a8c70ce817bc5ad2b50b9cdd8e91e1e9fdcac131516e0dfa93b451a82339 not found: ID does not exist"
Jul 12 21:55:16.513498 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513470    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 21:55:16.513749 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513738    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" containerName="registry"
Jul 12 21:55:16.513804 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513751    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" containerName="registry"
Jul 12 21:55:16.513804 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513760    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="config-reloader"
Jul 12 21:55:16.513804 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513766    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="config-reloader"
Jul 12 21:55:16.513804 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513774    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy"
Jul 12 21:55:16.513804 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513780    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy"
Jul 12 21:55:16.513804 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513786    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="prometheus"
Jul 12 21:55:16.513804 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513791    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="prometheus"
Jul 12 21:55:16.513804 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513798    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="init-config-reloader"
Jul 12 21:55:16.513804 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513803    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="init-config-reloader"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513810    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="thanos-sidecar"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513816    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="thanos-sidecar"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513821    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy-thanos"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513826    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy-thanos"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513832    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy-web"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513840    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy-web"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513884    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="config-reloader"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513890    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="thanos-sidecar"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513896    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy-web"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513900    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy-thanos"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513908    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2d7a0b5-5327-4e2d-a481-5b9fd9b4504e" containerName="registry"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513914    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="kube-rbac-proxy"
Jul 12 21:55:16.514059 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.513918    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" containerName="prometheus"
Jul 12 21:55:16.518889 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.518870    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.521484 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.521466    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 12 21:55:16.523776 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.523761    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 12 21:55:16.523776 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.523770    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 12 21:55:16.523952 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.523929    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3nlftlrdg819c\""
Jul 12 21:55:16.524137 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.523930    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 12 21:55:16.524601 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.524584    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 12 21:55:16.524722 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.524613    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 12 21:55:16.524722 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.524630    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 12 21:55:16.525012 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.524994    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 12 21:55:16.525202 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.525179    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 12 21:55:16.525409 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.525390    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hkztc\""
Jul 12 21:55:16.525577 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.525462    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 12 21:55:16.525851 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.525789    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 12 21:55:16.525919 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.525790    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 12 21:55:16.527055 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.527037    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 12 21:55:16.529599 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.529582    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 12 21:55:16.530568 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.530552    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 12 21:55:16.535958 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.535939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 21:55:16.621789 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.621756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.621789 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.621791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.621975 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.621811    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.621975 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.621853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.621975 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.621884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.621975 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.621903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9pws\" (UniqueName: \"kubernetes.io/projected/61c9e335-1e1a-4707-b32a-d7c8a71559b3-kube-api-access-p9pws\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.621975 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.621932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.621975 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.621967    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622151 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622151 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622151 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61c9e335-1e1a-4707-b32a-d7c8a71559b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622151 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622064    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622151 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-config\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622151 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622151 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61c9e335-1e1a-4707-b32a-d7c8a71559b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622255    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622284    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.622345 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.622334    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.668118 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.668084    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77f31e37-82e7-4fe2-8d9a-8732a0194ea4" path="/var/lib/kubelet/pods/77f31e37-82e7-4fe2-8d9a-8732a0194ea4/volumes"
Jul 12 21:55:16.723407 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.723331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61c9e335-1e1a-4707-b32a-d7c8a71559b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.723407 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.723365    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.723407 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.723391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-config\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.723634 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.723420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.723634 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.723438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.723634 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.723460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.723634 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.723476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61c9e335-1e1a-4707-b32a-d7c8a71559b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.723634 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.723492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.724452 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724358    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724491    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724647    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9pws\" (UniqueName: \"kubernetes.io/projected/61c9e335-1e1a-4707-b32a-d7c8a71559b3-kube-api-access-p9pws\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724844    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.724907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726127 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.725197    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726968 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.726221    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726968 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.726557    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726968 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.726669    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726968 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.726765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-config\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.726968 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.726895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.727222 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.727121    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.727415 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.727390    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.727523 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.727431    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.727523 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.727446    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61c9e335-1e1a-4707-b32a-d7c8a71559b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.728115 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.728094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.728413 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.728384    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61c9e335-1e1a-4707-b32a-d7c8a71559b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.728671 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.728647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.729007 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.728988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.729353 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.729337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.729586 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.729569    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/61c9e335-1e1a-4707-b32a-d7c8a71559b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.730098 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.730081    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/61c9e335-1e1a-4707-b32a-d7c8a71559b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.735072 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.735055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9pws\" (UniqueName: \"kubernetes.io/projected/61c9e335-1e1a-4707-b32a-d7c8a71559b3-kube-api-access-p9pws\") pod \"prometheus-k8s-0\" (UID: \"61c9e335-1e1a-4707-b32a-d7c8a71559b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.828917 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.828883    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:16.968308 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:16.968160    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 12 21:55:16.970560 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:55:16.970533    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c9e335_1e1a_4707_b32a_d7c8a71559b3.slice/crio-784f9f0b0ad870cb1a99d26139bdbb9abaa3f19c8b3f6e699b04e76f2af52aef WatchSource:0}: Error finding container 784f9f0b0ad870cb1a99d26139bdbb9abaa3f19c8b3f6e699b04e76f2af52aef: Status 404 returned error can't find the container with id 784f9f0b0ad870cb1a99d26139bdbb9abaa3f19c8b3f6e699b04e76f2af52aef
Jul 12 21:55:17.414612 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:17.414577    2581 generic.go:356] "Generic (PLEG): container finished" podID="61c9e335-1e1a-4707-b32a-d7c8a71559b3" containerID="7d07598aa2a0c0dbb38c592dda7d1ef468759bebf9d4a5b20ea0f6ea3ebde785" exitCode=0
Jul 12 21:55:17.414803 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:17.414658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61c9e335-1e1a-4707-b32a-d7c8a71559b3","Type":"ContainerDied","Data":"7d07598aa2a0c0dbb38c592dda7d1ef468759bebf9d4a5b20ea0f6ea3ebde785"}
Jul 12 21:55:17.414803 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:17.414790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61c9e335-1e1a-4707-b32a-d7c8a71559b3","Type":"ContainerStarted","Data":"784f9f0b0ad870cb1a99d26139bdbb9abaa3f19c8b3f6e699b04e76f2af52aef"}
Jul 12 21:55:18.423502 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:18.423469    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61c9e335-1e1a-4707-b32a-d7c8a71559b3","Type":"ContainerStarted","Data":"da5b03bacb53c8fecc21d3b99ed3d0926ec1f1215ccde1a557be24a3d14a394a"}
Jul 12 21:55:18.423880 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:18.423534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61c9e335-1e1a-4707-b32a-d7c8a71559b3","Type":"ContainerStarted","Data":"e1ade476876e63e79adede90a8eba36ed3462d3c5c23b66e52d9f4ec695008a0"}
Jul 12 21:55:18.423880 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:18.423559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61c9e335-1e1a-4707-b32a-d7c8a71559b3","Type":"ContainerStarted","Data":"a6e1fb882b20e278e94c38fa9c09fbf03b204324c5f69463168b895f8e93d9ed"}
Jul 12 21:55:18.423880 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:18.423583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61c9e335-1e1a-4707-b32a-d7c8a71559b3","Type":"ContainerStarted","Data":"f55ee2b0acfbfa9b2d0f9dffcb588186e502cb588c175f592087578ef9cb5d93"}
Jul 12 21:55:18.423880 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:18.423607    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61c9e335-1e1a-4707-b32a-d7c8a71559b3","Type":"ContainerStarted","Data":"32dd4e66519c79972906914066109526cb64e11a1fbc934300d646ad58d0d4f5"}
Jul 12 21:55:18.423880 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:18.423630    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"61c9e335-1e1a-4707-b32a-d7c8a71559b3","Type":"ContainerStarted","Data":"2a5ee5a47eecb2beb1ecd621dc351233fa3012bc3ec547801045df39cc318bcc"}
Jul 12 21:55:18.454672 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:18.454618    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.436300275 podStartE2EDuration="2.454603079s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.302804ms" isStatefulPod=false podCreationTimestamp="2026-07-12 21:55:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:55:18.454545092 +0000 UTC m=+176.318231646" watchObservedRunningTime="2026-07-12 21:55:18.454603079 +0000 UTC m=+176.318289591"
Jul 12 21:55:19.618202 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:19.618168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:55:19.719687 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:19.719619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:55:21.829747 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:21.829674    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:55:23.022210 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:23.022167    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:55:31.013970 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:31.013930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:55:31.073838 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:31.073806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:55:31.144018 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:55:31.143985    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:06.026869 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:06.026834    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:06.087761 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:06.087716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:16.829997 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:16.829962    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:56:16.844945 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:16.844916    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:56:17.669264 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:17.669234    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 12 21:56:25.802936 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:25.802897    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:25.903143 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:25.903113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:27.278860 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:27.278830    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:27.350330 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:27.350300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:27.430798 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:27.430760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:28.008987 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:28.008950    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:28.114281 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:28.114246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:37.731510 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:37.731471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:37.799327 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:37.799293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:38.315939 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:38.315906    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:38.414715 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:38.414669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:38.480606 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:38.480576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:47.268902 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:47.268825    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:47.393832 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:47.393802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:48.819786 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:48.819756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:56:48.911203 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:56:48.911162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:12.053019 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:12.052988    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:12.150794 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:12.150761    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:22.517419 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:22.517387    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 21:57:22.521224 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:22.521199    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 21:57:22.522394 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:22.522375    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 12 21:57:30.376676 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:30.376642    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:30.440419 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:30.440393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:33.860845 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:33.860811    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:34.665224 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:34.665192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:37.480916 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:37.480882    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:37.576996 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:37.576965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:38.715342 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:38.715310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:38.823337 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:38.823306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:38.952989 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:38.952960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:40.993747 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:40.993711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:41.346815 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.346788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:41.376485 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.376453    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nth6c"]
Jul 12 21:57:41.379560 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.379539    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nth6c"
Jul 12 21:57:41.383250 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.383229    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 12 21:57:41.384531 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.384512    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 12 21:57:41.384667 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.384550    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cngsc\""
Jul 12 21:57:41.391196 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.391177    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nth6c"]
Jul 12 21:57:41.494281 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.494242    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8w57\" (UniqueName: \"kubernetes.io/projected/5572f153-ee20-4b8e-892c-0c2a2a322715-kube-api-access-z8w57\") pod \"cert-manager-cainjector-559cdd8c87-nth6c\" (UID: \"5572f153-ee20-4b8e-892c-0c2a2a322715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nth6c"
Jul 12 21:57:41.494462 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.494301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5572f153-ee20-4b8e-892c-0c2a2a322715-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nth6c\" (UID: \"5572f153-ee20-4b8e-892c-0c2a2a322715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nth6c"
Jul 12 21:57:41.595384 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.595348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5572f153-ee20-4b8e-892c-0c2a2a322715-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nth6c\" (UID: \"5572f153-ee20-4b8e-892c-0c2a2a322715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nth6c"
Jul 12 21:57:41.595550 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.595430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8w57\" (UniqueName: \"kubernetes.io/projected/5572f153-ee20-4b8e-892c-0c2a2a322715-kube-api-access-z8w57\") pod \"cert-manager-cainjector-559cdd8c87-nth6c\" (UID: \"5572f153-ee20-4b8e-892c-0c2a2a322715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nth6c"
Jul 12 21:57:41.609777 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.609718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5572f153-ee20-4b8e-892c-0c2a2a322715-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nth6c\" (UID: \"5572f153-ee20-4b8e-892c-0c2a2a322715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nth6c"
Jul 12 21:57:41.609877 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.609822    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8w57\" (UniqueName: \"kubernetes.io/projected/5572f153-ee20-4b8e-892c-0c2a2a322715-kube-api-access-z8w57\") pod \"cert-manager-cainjector-559cdd8c87-nth6c\" (UID: \"5572f153-ee20-4b8e-892c-0c2a2a322715\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nth6c"
Jul 12 21:57:41.708520 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.708491    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nth6c"
Jul 12 21:57:41.831400 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.831371    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nth6c"]
Jul 12 21:57:41.834231 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:57:41.834201    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5572f153_ee20_4b8e_892c_0c2a2a322715.slice/crio-b15d00df659f351f5d5ba1b90cf0a9988e8dc92a50de6c55e9155fcc06641e39 WatchSource:0}: Error finding container b15d00df659f351f5d5ba1b90cf0a9988e8dc92a50de6c55e9155fcc06641e39: Status 404 returned error can't find the container with id b15d00df659f351f5d5ba1b90cf0a9988e8dc92a50de6c55e9155fcc06641e39
Jul 12 21:57:41.836176 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.836160    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 21:57:41.960167 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:41.960087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nth6c" event={"ID":"5572f153-ee20-4b8e-892c-0c2a2a322715","Type":"ContainerStarted","Data":"b15d00df659f351f5d5ba1b90cf0a9988e8dc92a50de6c55e9155fcc06641e39"}
Jul 12 21:57:44.283955 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:44.283916    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:44.395581 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:44.395473    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:44.973714 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:44.973673    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nth6c" event={"ID":"5572f153-ee20-4b8e-892c-0c2a2a322715","Type":"ContainerStarted","Data":"68fa7da47ab3a26def879bbc5d4740f68d04f1419feb69abecf49d6cc5858e50"}
Jul 12 21:57:44.996648 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:44.996592    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nth6c" podStartSLOduration=1.011939708 podStartE2EDuration="3.996563975s" totalImagesPullingTime="2.984624267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:57:44.99428116 +0000 UTC m=+322.857967673" watchObservedRunningTime="2026-07-12 21:57:44.996563975 +0000 UTC m=+322.860250489"
Jul 12 21:57:45.647922 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:45.647885    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:45.752349 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:45.752316    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:49.330989 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:49.330949    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:53.500572 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:53.500526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:53.593937 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:53.593910    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:59.090841 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.090788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:59.187351 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.187308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:57:59.478470 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.478387    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sqppf"]
Jul 12 21:57:59.481790 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.481767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-sqppf"
Jul 12 21:57:59.484315 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.484297    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-c2v5r\""
Jul 12 21:57:59.491847 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.491827    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sqppf"]
Jul 12 21:57:59.544084 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.544057    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b16ec5fc-5227-4036-b01a-f272966d7520-bound-sa-token\") pod \"cert-manager-55b4d954d5-sqppf\" (UID: \"b16ec5fc-5227-4036-b01a-f272966d7520\") " pod="cert-manager/cert-manager-55b4d954d5-sqppf"
Jul 12 21:57:59.544200 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.544108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qslb\" (UniqueName: \"kubernetes.io/projected/b16ec5fc-5227-4036-b01a-f272966d7520-kube-api-access-7qslb\") pod \"cert-manager-55b4d954d5-sqppf\" (UID: \"b16ec5fc-5227-4036-b01a-f272966d7520\") " pod="cert-manager/cert-manager-55b4d954d5-sqppf"
Jul 12 21:57:59.645120 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.645090    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qslb\" (UniqueName: \"kubernetes.io/projected/b16ec5fc-5227-4036-b01a-f272966d7520-kube-api-access-7qslb\") pod \"cert-manager-55b4d954d5-sqppf\" (UID: \"b16ec5fc-5227-4036-b01a-f272966d7520\") " pod="cert-manager/cert-manager-55b4d954d5-sqppf"
Jul 12 21:57:59.645263 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.645143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b16ec5fc-5227-4036-b01a-f272966d7520-bound-sa-token\") pod \"cert-manager-55b4d954d5-sqppf\" (UID: \"b16ec5fc-5227-4036-b01a-f272966d7520\") " pod="cert-manager/cert-manager-55b4d954d5-sqppf"
Jul 12 21:57:59.653968 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.653939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b16ec5fc-5227-4036-b01a-f272966d7520-bound-sa-token\") pod \"cert-manager-55b4d954d5-sqppf\" (UID: \"b16ec5fc-5227-4036-b01a-f272966d7520\") " pod="cert-manager/cert-manager-55b4d954d5-sqppf"
Jul 12 21:57:59.654055 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.653996    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qslb\" (UniqueName: \"kubernetes.io/projected/b16ec5fc-5227-4036-b01a-f272966d7520-kube-api-access-7qslb\") pod \"cert-manager-55b4d954d5-sqppf\" (UID: \"b16ec5fc-5227-4036-b01a-f272966d7520\") " pod="cert-manager/cert-manager-55b4d954d5-sqppf"
Jul 12 21:57:59.790148 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.790075    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-sqppf"
Jul 12 21:57:59.918902 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:57:59.918769    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-sqppf"]
Jul 12 21:57:59.921494 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:57:59.921463    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb16ec5fc_5227_4036_b01a_f272966d7520.slice/crio-1ede49ce93dd0b8fb2e136ed942b2a1c27739156229fcdd9e2e23c7c12cede64 WatchSource:0}: Error finding container 1ede49ce93dd0b8fb2e136ed942b2a1c27739156229fcdd9e2e23c7c12cede64: Status 404 returned error can't find the container with id 1ede49ce93dd0b8fb2e136ed942b2a1c27739156229fcdd9e2e23c7c12cede64
Jul 12 21:58:00.031227 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:00.031196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-sqppf" event={"ID":"b16ec5fc-5227-4036-b01a-f272966d7520","Type":"ContainerStarted","Data":"457717d2e2b5b6488235260a2cf603e6cbf2441fd7246a7858d367d0a1323fde"}
Jul 12 21:58:00.031369 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:00.031238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-sqppf" event={"ID":"b16ec5fc-5227-4036-b01a-f272966d7520","Type":"ContainerStarted","Data":"1ede49ce93dd0b8fb2e136ed942b2a1c27739156229fcdd9e2e23c7c12cede64"}
Jul 12 21:58:00.050719 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:00.050620    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-sqppf" podStartSLOduration=1.050603522 podStartE2EDuration="1.050603522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:57:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:58:00.048977652 +0000 UTC m=+337.912664164" watchObservedRunningTime="2026-07-12 21:58:00.050603522 +0000 UTC m=+337.914290036"
Jul 12 21:58:01.131964 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:01.131934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:15.912338 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:15.912236    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:16.022041 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:16.022009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:16.504267 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:16.504225    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:16.793780 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:16.793685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:16.935910 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:16.935875    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:16.981462 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:16.981432    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"]
Jul 12 21:58:16.984711 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:16.984678    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:16.988401 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:16.988377    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 12 21:58:16.988518 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:16.988442    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2p5vq\""
Jul 12 21:58:16.989199 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:16.989180    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 12 21:58:16.989504 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:16.989488    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 12 21:58:16.989786 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:16.989772    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 12 21:58:17.000024 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.000002    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"]
Jul 12 21:58:17.083928 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.083901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f28e5a47-6d5d-4e11-8f22-2f847413aa02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.084056 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.083966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f28e5a47-6d5d-4e11-8f22-2f847413aa02-manifests\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.084056 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.084003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f28e5a47-6d5d-4e11-8f22-2f847413aa02-tmp\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.084056 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.084029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cf5t\" (UniqueName: \"kubernetes.io/projected/f28e5a47-6d5d-4e11-8f22-2f847413aa02-kube-api-access-9cf5t\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.084159 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.084076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f28e5a47-6d5d-4e11-8f22-2f847413aa02-webhook-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.149315 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.149289    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:17.184625 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.184596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f28e5a47-6d5d-4e11-8f22-2f847413aa02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.184794 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.184657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f28e5a47-6d5d-4e11-8f22-2f847413aa02-manifests\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.184794 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.184682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f28e5a47-6d5d-4e11-8f22-2f847413aa02-tmp\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.184794 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.184728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cf5t\" (UniqueName: \"kubernetes.io/projected/f28e5a47-6d5d-4e11-8f22-2f847413aa02-kube-api-access-9cf5t\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.184951 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.184865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f28e5a47-6d5d-4e11-8f22-2f847413aa02-webhook-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.185103 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.185085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f28e5a47-6d5d-4e11-8f22-2f847413aa02-manifests\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.186937 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.186913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f28e5a47-6d5d-4e11-8f22-2f847413aa02-tmp\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.187164 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.187145    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f28e5a47-6d5d-4e11-8f22-2f847413aa02-webhook-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.187262 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.187244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f28e5a47-6d5d-4e11-8f22-2f847413aa02-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.196927 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.196897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cf5t\" (UniqueName: \"kubernetes.io/projected/f28e5a47-6d5d-4e11-8f22-2f847413aa02-kube-api-access-9cf5t\") pod \"opendatahub-operator-controller-manager-d867dd548-ms6pz\" (UID: \"f28e5a47-6d5d-4e11-8f22-2f847413aa02\") " pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.244168 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.244138    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:17.295336 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.295308    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:17.346294 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.346261    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:17.436426 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.436380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:17.436800 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.436776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"]
Jul 12 21:58:17.441228 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:58:17.441205    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28e5a47_6d5d_4e11_8f22_2f847413aa02.slice/crio-dd5e91c02472652774d0c28f4c29b320c8478f1c282618f36e14c016a89adb37 WatchSource:0}: Error finding container dd5e91c02472652774d0c28f4c29b320c8478f1c282618f36e14c016a89adb37: Status 404 returned error can't find the container with id dd5e91c02472652774d0c28f4c29b320c8478f1c282618f36e14c016a89adb37
Jul 12 21:58:17.511904 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.511876    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:17.618611 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.618537    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:17.731795 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:17.731764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:18.105473 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:18.105394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz" event={"ID":"f28e5a47-6d5d-4e11-8f22-2f847413aa02","Type":"ContainerStarted","Data":"dd5e91c02472652774d0c28f4c29b320c8478f1c282618f36e14c016a89adb37"}
Jul 12 21:58:21.119665 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:21.119630    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz" event={"ID":"f28e5a47-6d5d-4e11-8f22-2f847413aa02","Type":"ContainerStarted","Data":"129fd1b56eabc6accd6b8d6279d87cc78a65f3be8fe019f777e884a0a94bfa8f"}
Jul 12 21:58:22.130720 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:22.130668    2581 generic.go:356] "Generic (PLEG): container finished" podID="f28e5a47-6d5d-4e11-8f22-2f847413aa02" containerID="129fd1b56eabc6accd6b8d6279d87cc78a65f3be8fe019f777e884a0a94bfa8f" exitCode=0
Jul 12 21:58:22.131091 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:22.130722    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz" event={"ID":"f28e5a47-6d5d-4e11-8f22-2f847413aa02","Type":"ContainerDied","Data":"129fd1b56eabc6accd6b8d6279d87cc78a65f3be8fe019f777e884a0a94bfa8f"}
Jul 12 21:58:23.136196 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:23.136161    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz" event={"ID":"f28e5a47-6d5d-4e11-8f22-2f847413aa02","Type":"ContainerStarted","Data":"a60970c38d536378102765fe92c06b89262d7e19eb7f766b72370276c6be3d62"}
Jul 12 21:58:23.136607 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:23.136256    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:23.165685 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:23.165631    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz" podStartSLOduration=2.786319935 podStartE2EDuration="7.165617564s" totalImagesPullingTime="3.332079543s" totalInitContainerRuntime="1.047218086s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:58:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:58:23.164271765 +0000 UTC m=+361.027958278" watchObservedRunningTime="2026-07-12 21:58:23.165617564 +0000 UTC m=+361.029304079"
Jul 12 21:58:34.141967 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:34.141933    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d867dd548-ms6pz"
Jul 12 21:58:36.299896 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:36.299866    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:36.430008 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:36.429971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:36.984498 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:36.984459    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:37.140669 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.140621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:37.175466 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.175430    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"]
Jul 12 21:58:37.184370 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.184343    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.188392 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.188371    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 12 21:58:37.189651 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.189626    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-v9x82\""
Jul 12 21:58:37.190172 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.189867    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 12 21:58:37.190172 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.189950    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 12 21:58:37.190172 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.189977    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 12 21:58:37.190172 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.190090    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 12 21:58:37.195766 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.195741    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"]
Jul 12 21:58:37.253291 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.253199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-manager-config\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.253291 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.253243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-metrics-cert\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.253291 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.253271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngqxg\" (UniqueName: \"kubernetes.io/projected/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-kube-api-access-ngqxg\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.253531 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.253353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-cert\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.354373 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.354333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-manager-config\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.354860 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.354387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-metrics-cert\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.354860 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.354428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngqxg\" (UniqueName: \"kubernetes.io/projected/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-kube-api-access-ngqxg\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.354860 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.354476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-cert\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.355081 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.355062    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-manager-config\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.356865 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.356841    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-cert\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.356962 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.356918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-metrics-cert\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.371657 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.371625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngqxg\" (UniqueName: \"kubernetes.io/projected/5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8-kube-api-access-ngqxg\") pod \"lws-controller-manager-db9cf56f-s44gh\" (UID: \"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8\") " pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.374631 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.374599    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:37.497284 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.497247    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:37.537416 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.537322    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:37.643846 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.643813    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"]
Jul 12 21:58:37.647581 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:58:37.647556    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad0dfd5_1b0c_4153_9ddc_a85f2f06e9b8.slice/crio-d7aa01f8d2beafbf67b82a3d3326e157a8bafceec4b16d35339f0f2df78a338d WatchSource:0}: Error finding container d7aa01f8d2beafbf67b82a3d3326e157a8bafceec4b16d35339f0f2df78a338d: Status 404 returned error can't find the container with id d7aa01f8d2beafbf67b82a3d3326e157a8bafceec4b16d35339f0f2df78a338d
Jul 12 21:58:37.697467 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:37.697435    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:38.201455 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:38.201421    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh" event={"ID":"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8","Type":"ContainerStarted","Data":"d7aa01f8d2beafbf67b82a3d3326e157a8bafceec4b16d35339f0f2df78a338d"}
Jul 12 21:58:38.375967 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:38.375937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:38.804158 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:38.804084    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:39.089257 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:39.089223    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:39.186652 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:39.186589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:40.372681 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:40.372646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:41.218648 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:41.218611    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh" event={"ID":"5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8","Type":"ContainerStarted","Data":"42a82c13f4d7673a06903b5b1f73ee68667c7c512b9f9428e88c575b9dfb0ddb"}
Jul 12 21:58:41.218872 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:41.218851    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:41.241208 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:41.241157    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh" podStartSLOduration=1.50584447 podStartE2EDuration="4.241139793s" totalImagesPullingTime="2.735295323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:58:41.240140824 +0000 UTC m=+379.103827348" watchObservedRunningTime="2026-07-12 21:58:41.241139793 +0000 UTC m=+379.104826339"
Jul 12 21:58:44.667032 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:44.667000    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:44.769590 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:44.769553    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:45.076308 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.076231    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"]
Jul 12 21:58:45.079489 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.079468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.082481 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.082456    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 12 21:58:45.082481 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.082470    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 12 21:58:45.082643 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.082533    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-57gzk\""
Jul 12 21:58:45.082643 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.082459    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 12 21:58:45.083033 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.083010    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 12 21:58:45.093243 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.093219    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"]
Jul 12 21:58:45.231602 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.231561    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f08b9e69-3012-46f2-aef7-ed55612e91be-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.231802 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.231610    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.231802 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.231673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.231802 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.231690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.231802 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.231770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96wx5\" (UniqueName: \"kubernetes.io/projected/f08b9e69-3012-46f2-aef7-ed55612e91be-kube-api-access-96wx5\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.231942 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.231820    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08b9e69-3012-46f2-aef7-ed55612e91be-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.231942 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.231840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.333287 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.333255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.333467 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.333325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.333467 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.333342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.333467 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.333363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96wx5\" (UniqueName: \"kubernetes.io/projected/f08b9e69-3012-46f2-aef7-ed55612e91be-kube-api-access-96wx5\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.333467 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.333391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08b9e69-3012-46f2-aef7-ed55612e91be-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.333467 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.333409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.333467 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.333451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f08b9e69-3012-46f2-aef7-ed55612e91be-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.334247 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.334220    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.336009 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.335961    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.336190 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.336169    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.336352 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.336329    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f08b9e69-3012-46f2-aef7-ed55612e91be-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.337323 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.337304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08b9e69-3012-46f2-aef7-ed55612e91be-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.343234 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.343212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08b9e69-3012-46f2-aef7-ed55612e91be-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.344360 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.344333    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96wx5\" (UniqueName: \"kubernetes.io/projected/f08b9e69-3012-46f2-aef7-ed55612e91be-kube-api-access-96wx5\") pod \"istiod-openshift-gateway-94bb8fbfd-bfw4f\" (UID: \"f08b9e69-3012-46f2-aef7-ed55612e91be\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.396074 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.396037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:45.509308 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.509220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:45.560011 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.559981    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"]
Jul 12 21:58:45.567773 ip-10-0-143-64 kubenswrapper[2581]: W0712 21:58:45.567690    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08b9e69_3012_46f2_aef7_ed55612e91be.slice/crio-f5a402e91e200a751fc5b4ec4e3fcf7e03e238a34dc70a252fac6fea834d37cf WatchSource:0}: Error finding container f5a402e91e200a751fc5b4ec4e3fcf7e03e238a34dc70a252fac6fea834d37cf: Status 404 returned error can't find the container with id f5a402e91e200a751fc5b4ec4e3fcf7e03e238a34dc70a252fac6fea834d37cf
Jul 12 21:58:45.680388 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.680289    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:45.902174 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:45.902143    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:46.244031 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:46.243997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f" event={"ID":"f08b9e69-3012-46f2-aef7-ed55612e91be","Type":"ContainerStarted","Data":"f5a402e91e200a751fc5b4ec4e3fcf7e03e238a34dc70a252fac6fea834d37cf"}
Jul 12 21:58:47.891458 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:47.891422    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 21:58:47.891834 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:47.891503    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 21:58:48.255501 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:48.255411    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f" event={"ID":"f08b9e69-3012-46f2-aef7-ed55612e91be","Type":"ContainerStarted","Data":"440aa907ef155f18369cdec05eea8500870fef3ed08424ec16ef8d39c48fe803"}
Jul 12 21:58:48.255670 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:48.255629    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:48.257132 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:48.257101    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-bfw4f container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 21:58:48.257263 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:48.257152    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f" podUID="f08b9e69-3012-46f2-aef7-ed55612e91be" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 21:58:48.299939 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:48.299855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:48.348186 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:48.348130    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f" podStartSLOduration=1.026925277 podStartE2EDuration="3.348114667s" totalImagesPullingTime="2.32118939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 21:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 21:58:48.347099918 +0000 UTC m=+386.210786444" watchObservedRunningTime="2026-07-12 21:58:48.348114667 +0000 UTC m=+386.211801180"
Jul 12 21:58:48.499874 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:48.499840    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:48.624118 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:48.624071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:48.722502 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:48.722464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:48.818308 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:48.818278    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:48.943935 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:48.943845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:49.260479 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:49.260394    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bfw4f"
Jul 12 21:58:52.226533 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:52.226504    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-db9cf56f-s44gh"
Jul 12 21:58:55.275371 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:55.275334    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:58:55.337685 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:58:55.337652    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:59:18.374377 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:59:18.374346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:59:37.722664 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:59:37.722621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:59:37.816407 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:59:37.816379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 21:59:37.917874 ip-10-0-143-64 kubenswrapper[2581]: I0712 21:59:37.917841    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:05.431366 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:05.431324    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:09.197775 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:09.197740    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:11.881409 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:11.881377    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:11.998407 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:11.998376    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:12.490635 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:12.490588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:13.932239 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:13.932206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:16.601438 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:16.601407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:16.992985 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:16.992903    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:17.730764 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:17.730731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:17.854284 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:17.854244    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:20.252815 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:20.252782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:20.383808 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:20.383760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:20.503056 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:20.502969    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:20.687120 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:20.687086    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:20.954642 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:20.954603    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:21.055303 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:21.055274    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:21.401416 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:21.401384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:21.501086 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:21.501055    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:25.219041 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:25.219013    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:25.320947 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:25.320919    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:26.319952 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:26.319921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:26.512400 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:26.512366    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:27.944217 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:27.944178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:28.045276 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:28.045240    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:28.145368 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:28.145335    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:28.246494 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:28.246414    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:28.599580 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:28.599545    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:28.701072 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:28.701037    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:31.425468 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:31.425438    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:31.526513 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:31.526477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:31.586260 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:31.586234    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:34.629530 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:34.629495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:34.724894 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:34.724863    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:36.848082 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:36.848052    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"]
Jul 12 22:00:36.851350 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:36.851334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:36.856556 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:36.856522    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 22:00:36.856556 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:36.856522    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kgzgg\""
Jul 12 22:00:36.856746 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:36.856588    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 22:00:36.865354 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:36.865327    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"]
Jul 12 22:00:36.935463 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:36.935435    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"]
Jul 12 22:00:36.935709 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:00:36.935681    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-5vgrw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb" podUID="f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911"
Jul 12 22:00:36.944304 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:36.944276    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"]
Jul 12 22:00:36.976022 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:36.975987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vgrw\" (UniqueName: \"kubernetes.io/projected/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-kube-api-access-5vgrw\") pod \"kuadrant-operator-controller-manager-86878c769f-xxhrb\" (UID: \"f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:36.976154 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:36.976089    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xxhrb\" (UID: \"f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:37.077418 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.077377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgrw\" (UniqueName: \"kubernetes.io/projected/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-kube-api-access-5vgrw\") pod \"kuadrant-operator-controller-manager-86878c769f-xxhrb\" (UID: \"f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:37.077575 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.077542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xxhrb\" (UID: \"f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:37.077932 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.077910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xxhrb\" (UID: \"f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:37.080479 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:00:37.080461    2581 projected.go:196] Error preparing data for projected volume kube-api-access-5vgrw for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-143-64.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-143-64.ec2.internal' and this object
Jul 12 22:00:37.080546 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:00:37.080521    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-kube-api-access-5vgrw podName:f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911 nodeName:}" failed. No retries permitted until 2026-07-12 22:00:37.580505519 +0000 UTC m=+495.444192013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5vgrw" (UniqueName: "kubernetes.io/projected/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-kube-api-access-5vgrw") pod "kuadrant-operator-controller-manager-86878c769f-xxhrb" (UID: "f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-143-64.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-143-64.ec2.internal' and this object
Jul 12 22:00:37.470270 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.470237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:37.551671 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.551639    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:37.582202 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.582168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgrw\" (UniqueName: \"kubernetes.io/projected/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-kube-api-access-5vgrw\") pod \"kuadrant-operator-controller-manager-86878c769f-xxhrb\" (UID: \"f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:37.584760 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:00:37.584744    2581 projected.go:196] Error preparing data for projected volume kube-api-access-5vgrw for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb: failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-143-64.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-143-64.ec2.internal' and this object
Jul 12 22:00:37.584852 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:00:37.584807    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-kube-api-access-5vgrw podName:f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911 nodeName:}" failed. No retries permitted until 2026-07-12 22:00:38.584788966 +0000 UTC m=+496.448475457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vgrw" (UniqueName: "kubernetes.io/projected/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-kube-api-access-5vgrw") pod "kuadrant-operator-controller-manager-86878c769f-xxhrb" (UID: "f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911") : failed to fetch token: serviceaccounts "kuadrant-operator-controller-manager" is forbidden: User "system:node:ip-10-0-143-64.ec2.internal" cannot create resource "serviceaccounts/token" in API group "" in the namespace "kuadrant-system": no relationship found between node 'ip-10-0-143-64.ec2.internal' and this object
Jul 12 22:00:37.706955 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.706926    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:37.709567 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:00:37.709540    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-xxhrb\" is forbidden: User \"system:node:ip-10-0-143-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-64.ec2.internal' and this object" podUID="f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:37.713373 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.713356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:37.715924 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:00:37.715904    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-xxhrb\" is forbidden: User \"system:node:ip-10-0-143-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-64.ec2.internal' and this object" podUID="f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:37.885225 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.885192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-extensions-socket-volume\") pod \"f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911\" (UID: \"f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911\") "
Jul 12 22:00:37.885658 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.885375    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vgrw\" (UniqueName: \"kubernetes.io/projected/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-kube-api-access-5vgrw\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:00:37.885658 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.885494    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911" (UID: "f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:00:37.986284 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:37.986250    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911-extensions-socket-volume\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:00:38.668746 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:38.668693    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911" path="/var/lib/kubelet/pods/f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911/volumes"
Jul 12 22:00:38.710678 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:38.710643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:38.714970 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:00:38.714933    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-xxhrb\" is forbidden: User \"system:node:ip-10-0-143-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-64.ec2.internal' and this object" podUID="f4f9ed72-c47a-4cb2-8e9f-381e9e7c8911" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xxhrb"
Jul 12 22:00:39.782347 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:39.782311    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:39.881534 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:39.881506    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:42.613916 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:42.613879    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:42.710754 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:42.710721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:46.196505 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:46.196467    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:46.298638 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:46.298605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:55.033389 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:55.033351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:55.134072 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:55.134036    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:57.639538 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:57.639509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:00:57.741362 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:00:57.741332    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:00.838768 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:00.838741    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:00.938915 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:00.938875    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:04.437542 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:04.437506    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:04.537813 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:04.537765    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:05.617016 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:05.616980    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:05.894482 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:05.894398    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:07.413486 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.413432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:07.613025 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.612982    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:07.712999 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.712923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:07.810426 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.810398    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:01:07.813855 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.813823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w"
Jul 12 22:01:07.816828 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.816801    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 12 22:01:07.816944 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.816831    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 12 22:01:07.817055 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.817038    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 12 22:01:07.818069 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.818049    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4vb66\""
Jul 12 22:01:07.834312 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.834287    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:01:07.865055 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.865032    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:01:07.937004 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.936980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b21ed288-9b43-4f81-8fec-832f74a011f6-config-file\") pod \"limitador-limitador-54d6d988d5-znt9w\" (UID: \"b21ed288-9b43-4f81-8fec-832f74a011f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w"
Jul 12 22:01:07.937123 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:07.937022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb9bm\" (UniqueName: \"kubernetes.io/projected/b21ed288-9b43-4f81-8fec-832f74a011f6-kube-api-access-tb9bm\") pod \"limitador-limitador-54d6d988d5-znt9w\" (UID: \"b21ed288-9b43-4f81-8fec-832f74a011f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w"
Jul 12 22:01:08.037746 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:08.037652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb9bm\" (UniqueName: \"kubernetes.io/projected/b21ed288-9b43-4f81-8fec-832f74a011f6-kube-api-access-tb9bm\") pod \"limitador-limitador-54d6d988d5-znt9w\" (UID: \"b21ed288-9b43-4f81-8fec-832f74a011f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w"
Jul 12 22:01:08.037913 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:08.037778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b21ed288-9b43-4f81-8fec-832f74a011f6-config-file\") pod \"limitador-limitador-54d6d988d5-znt9w\" (UID: \"b21ed288-9b43-4f81-8fec-832f74a011f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w"
Jul 12 22:01:08.038409 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:08.038389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b21ed288-9b43-4f81-8fec-832f74a011f6-config-file\") pod \"limitador-limitador-54d6d988d5-znt9w\" (UID: \"b21ed288-9b43-4f81-8fec-832f74a011f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w"
Jul 12 22:01:08.047260 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:08.047236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb9bm\" (UniqueName: \"kubernetes.io/projected/b21ed288-9b43-4f81-8fec-832f74a011f6-kube-api-access-tb9bm\") pod \"limitador-limitador-54d6d988d5-znt9w\" (UID: \"b21ed288-9b43-4f81-8fec-832f74a011f6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w"
Jul 12 22:01:08.123610 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:08.123588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w"
Jul 12 22:01:08.257965 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:08.257939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:01:08.260913 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:01:08.260884    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21ed288_9b43_4f81_8fec_832f74a011f6.slice/crio-d8406f0535cc65a222bb6f5ab1b3cd12f20548f72f879739ef51c360f3dbd181 WatchSource:0}: Error finding container d8406f0535cc65a222bb6f5ab1b3cd12f20548f72f879739ef51c360f3dbd181: Status 404 returned error can't find the container with id d8406f0535cc65a222bb6f5ab1b3cd12f20548f72f879739ef51c360f3dbd181
Jul 12 22:01:08.295815 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:08.295747    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:08.371381 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:08.371348    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:08.836646 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:08.836557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w" event={"ID":"b21ed288-9b43-4f81-8fec-832f74a011f6","Type":"ContainerStarted","Data":"d8406f0535cc65a222bb6f5ab1b3cd12f20548f72f879739ef51c360f3dbd181"}
Jul 12 22:01:10.848717 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:10.848674    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w" event={"ID":"b21ed288-9b43-4f81-8fec-832f74a011f6","Type":"ContainerStarted","Data":"60029e250afed6330419d2c263e247fb050aa8a23601d6ec721ed057fc24307a"}
Jul 12 22:01:10.849100 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:10.848772    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w"
Jul 12 22:01:10.867899 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:10.867854    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w" podStartSLOduration=1.449026604 podStartE2EDuration="3.867837806s" totalImagesPullingTime="2.418811202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:01:10.866927979 +0000 UTC m=+528.730614491" watchObservedRunningTime="2026-07-12 22:01:10.867837806 +0000 UTC m=+528.731524317"
Jul 12 22:01:13.477584 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:13.477548    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:13.576861 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:13.576827    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:21.855272 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:21.855194    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-znt9w"
Jul 12 22:01:23.588045 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:23.588011    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:23.677027 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:23.676996    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:24.088052 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:24.088022    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:36.923073 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:36.923023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:37.591478 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:37.591439    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:44.410360 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:44.410324    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:44.517532 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:44.517493    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:44.584827 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:44.584797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:44.943431 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:44.943404    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:48.488273 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:48.488246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:01:48.586913 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:01:48.586873    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:22.414895 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:22.414855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:22.515803 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:22.515766    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:22.545656 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:22.545631    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:02:22.545837 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:22.545671    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:02:23.035938 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:23.035904    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:23.530854 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:23.530823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:23.636475 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:23.636440    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:23.728205 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:23.728167    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:23.929734 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:23.929684    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:02:34.844438 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:34.844399    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:34.986835 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:34.986807    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:41.851285 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:41.851240    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:42.345058 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:42.345025    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:02:54.369254 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:54.369220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:55.163867 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:55.163830    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:02:55.402822 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:55.402791    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:02:55.502550 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:02:55.502471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:03:00.942296 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:00.942260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:03:01.636901 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:01.636870    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:03:10.691371 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:10.691340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:03:10.904158 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:10.904123    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:03:10.977629 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:10.977560    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:03:12.539555 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:12.539520    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:03:19.481306 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:19.481263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:03:25.338620 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.338582    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"]
Jul 12 22:03:25.342348 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.342316    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.346320 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.346297    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 12 22:03:25.346448 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.346367    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 12 22:03:25.346448 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.346297    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z87st\""
Jul 12 22:03:25.346448 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.346430    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 12 22:03:25.351656 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.351632    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"]
Jul 12 22:03:25.363152 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.363123    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:03:25.398167 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.398135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.398365 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.398172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h72ck\" (UniqueName: \"kubernetes.io/projected/31b68f86-75bb-4f6d-910a-2b830e54d7ce-kube-api-access-h72ck\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.398365 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.398205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.398365 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.398263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.398365 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.398332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.398592 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.398368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31b68f86-75bb-4f6d-910a-2b830e54d7ce-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.499343 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.499307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.499343 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.499342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h72ck\" (UniqueName: \"kubernetes.io/projected/31b68f86-75bb-4f6d-910a-2b830e54d7ce-kube-api-access-h72ck\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.499606 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.499360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.499606 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.499379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.499606 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.499416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.499606 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.499448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31b68f86-75bb-4f6d-910a-2b830e54d7ce-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.499855 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.499830    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.499918 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.499873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.499918 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.499882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.501801 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.501782    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31b68f86-75bb-4f6d-910a-2b830e54d7ce-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.501955 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.501939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31b68f86-75bb-4f6d-910a-2b830e54d7ce-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.507968 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.507936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h72ck\" (UniqueName: \"kubernetes.io/projected/31b68f86-75bb-4f6d-910a-2b830e54d7ce-kube-api-access-h72ck\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zr9hj\" (UID: \"31b68f86-75bb-4f6d-910a-2b830e54d7ce\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.653644 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.653546    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:25.781115 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.781090    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"]
Jul 12 22:03:25.783645 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:03:25.783622    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b68f86_75bb_4f6d_910a_2b830e54d7ce.slice/crio-59d3a722cea191fccd0a175ed92a17baf6bcae626d379ff57d77d426fb0ef411 WatchSource:0}: Error finding container 59d3a722cea191fccd0a175ed92a17baf6bcae626d379ff57d77d426fb0ef411: Status 404 returned error can't find the container with id 59d3a722cea191fccd0a175ed92a17baf6bcae626d379ff57d77d426fb0ef411
Jul 12 22:03:25.785001 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:25.784979    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 22:03:26.424911 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:26.424877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj" event={"ID":"31b68f86-75bb-4f6d-910a-2b830e54d7ce","Type":"ContainerStarted","Data":"59d3a722cea191fccd0a175ed92a17baf6bcae626d379ff57d77d426fb0ef411"}
Jul 12 22:03:27.431054 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:27.431017    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj" event={"ID":"31b68f86-75bb-4f6d-910a-2b830e54d7ce","Type":"ContainerStarted","Data":"0053f87a344f4e62c17382efcce9cdc0c1b4a1d4b54fb065db6aab3f6c2f1ac2"}
Jul 12 22:03:27.448840 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:27.448810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:03:27.451643 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:27.451600    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj" podStartSLOduration=1.4307232349999999 podStartE2EDuration="2.451584885s" totalImagesPullingTime="1.02086165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:03:27.449967938 +0000 UTC m=+665.313654503" watchObservedRunningTime="2026-07-12 22:03:27.451584885 +0000 UTC m=+665.315271438"
Jul 12 22:03:35.654640 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:35.654603    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:35.655065 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:35.654690    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:35.667390 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:35.667364    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:36.486775 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:36.486733    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zr9hj"
Jul 12 22:03:41.485067 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:41.485029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:03:41.552823 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:41.552779    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:03:44.279322 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:44.279287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:03:46.949281 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:03:46.949249    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:05:32.190537 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:05:32.190502    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:05:32.287556 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:05:32.287520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:05:33.466949 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:05:33.466911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:05:33.655492 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:05:33.655460    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:06:00.842388 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:06:00.842354    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:06:11.440886 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:06:11.440848    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:06:21.855232 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:06:21.855201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:06:30.937599 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:06:30.937564    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:06:41.863767 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:06:41.863735    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:06:44.120988 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:06:44.120956    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:06:45.903644 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:06:45.903609    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:07:12.338490 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:12.338451    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:07:22.576531 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:22.576458    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:07:22.577558 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:22.577534    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:07:24.951192 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:24.951156    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:07:29.260994 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:29.260960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:07:30.845754 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:30.845682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:07:30.943023 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:30.942984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:07:31.178003 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:31.177915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:07:36.876395 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:36.876358    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:07:36.977878 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:36.977845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:07:37.079072 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:37.079038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:07:37.250769 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:37.250670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:07:43.216498 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:43.216455    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:07:44.331717 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:44.331660    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:07:59.637504 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:07:59.637472    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:08:09.744008 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:08:09.743973    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:08:20.930972 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:08:20.930935    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:08:29.745418 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:08:29.745385    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:08:38.141742 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:08:38.141708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:08:38.460250 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:08:38.460170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:08:38.559840 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:08:38.559810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:08:48.445314 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:08:48.445222    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:09:00.039875 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:09:00.039835    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:09:08.243989 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:09:08.243953    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:09:34.747692 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:09:34.747656    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:09:38.472639 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:09:38.472602    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:09:38.573073 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:09:38.573040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:09:44.641180 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:09:44.641141    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:10:07.540616 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:10:07.540588    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:10:19.628688 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:10:19.628603    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:10:36.150207 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:10:36.150165    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:10:46.241334 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:10:46.241295    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:10:56.929118 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:10:56.929071    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:11:00.313001 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:11:00.312967    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:11:06.845565 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:11:06.845532    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:11:16.838662 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:11:16.838631    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:12:22.604603 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:12:22.604571    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:12:22.606680 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:12:22.606656    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:12:24.329082 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:12:24.329045    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:12:24.431145 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:12:24.431111    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:13:01.739326 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:13:01.739284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:13:05.850212 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:13:05.850177    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:13:07.080656 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:13:07.080620    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:13:14.340005 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:13:14.339919    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:13:23.452947 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:13:23.452909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:13:34.841606 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:13:34.841570    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:13:46.341827 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:13:46.341791    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:13:56.541928 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:13:56.541892    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:14:05.248917 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:14:05.248878    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:14:16.938108 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:14:16.938068    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:14:27.341665 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:14:27.341623    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:14:30.552474 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:14:30.552441    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:14:36.952231 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:14:36.952197    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:14:49.143059 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:14:49.142983    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:15:00.140873 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:00.140841    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt"]
Jul 12 22:15:00.144144 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:00.144127    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt"
Jul 12 22:15:00.146960 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:00.146940    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:15:00.153763 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:00.153746    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt"
Jul 12 22:15:00.160167 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:00.160143    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt"]
Jul 12 22:15:00.287717 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:00.287663    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt"]
Jul 12 22:15:00.290202 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:15:00.290171    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17596c7a_e53c_46f7_912f_b52893bd3476.slice/crio-aa8d771570e9af384112ea4003c9d38bc6e288bd1f39ee0fb4559b6489f39035 WatchSource:0}: Error finding container aa8d771570e9af384112ea4003c9d38bc6e288bd1f39ee0fb4559b6489f39035: Status 404 returned error can't find the container with id aa8d771570e9af384112ea4003c9d38bc6e288bd1f39ee0fb4559b6489f39035
Jul 12 22:15:00.292071 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:00.292055    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 22:15:00.434891 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:00.434808    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt" event={"ID":"17596c7a-e53c-46f7-912f-b52893bd3476","Type":"ContainerStarted","Data":"aa8d771570e9af384112ea4003c9d38bc6e288bd1f39ee0fb4559b6489f39035"}
Jul 12 22:15:03.450556 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:03.450520    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt" event={"ID":"17596c7a-e53c-46f7-912f-b52893bd3476","Type":"ContainerStarted","Data":"25deb979e519b3cc965e439e34039a4b4543203f3ef9196da1013bc225f3cbc3"}
Jul 12 22:15:03.469205 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:03.469157    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt" podStartSLOduration=1.299873586 podStartE2EDuration="3.46913973s" totalImagesPullingTime="2.169266144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:15:03.468308037 +0000 UTC m=+1361.331994545" watchObservedRunningTime="2026-07-12 22:15:03.46913973 +0000 UTC m=+1361.332826257"
Jul 12 22:15:04.456506 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:04.456474    2581 generic.go:356] "Generic (PLEG): container finished" podID="17596c7a-e53c-46f7-912f-b52893bd3476" containerID="25deb979e519b3cc965e439e34039a4b4543203f3ef9196da1013bc225f3cbc3" exitCode=0
Jul 12 22:15:04.456936 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:04.456543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt" event={"ID":"17596c7a-e53c-46f7-912f-b52893bd3476","Type":"ContainerDied","Data":"25deb979e519b3cc965e439e34039a4b4543203f3ef9196da1013bc225f3cbc3"}
Jul 12 22:15:05.592953 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:05.592925    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt"
Jul 12 22:15:06.466297 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:06.466267    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt"
Jul 12 22:15:06.466297 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:06.466279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731575-6bfgt" event={"ID":"17596c7a-e53c-46f7-912f-b52893bd3476","Type":"ContainerDied","Data":"aa8d771570e9af384112ea4003c9d38bc6e288bd1f39ee0fb4559b6489f39035"}
Jul 12 22:15:06.466510 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:06.466323    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa8d771570e9af384112ea4003c9d38bc6e288bd1f39ee0fb4559b6489f39035"
Jul 12 22:15:13.859926 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:13.859888    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:15:21.776472 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:21.776437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:15:34.844288 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:34.844253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:15:46.941050 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:15:46.941014    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:16:02.848791 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:16:02.848753    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:16:14.379966 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:16:14.379878    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:16:27.036011 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:16:27.035974    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:16:40.541605 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:16:40.541570    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:16:48.834080 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:16:48.834047    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:17:00.046953 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:17:00.046916    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:17:18.545135 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:17:18.545100    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:17:22.631930 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:17:22.631904    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:17:22.634525 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:17:22.634502    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:17:30.464338 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:17:30.464305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:17:36.447082 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:17:36.447038    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:17:44.739770 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:17:44.739681    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:17:56.746236 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:17:56.746201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:18:14.557487 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:18:14.557451    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:18:26.647513 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:18:26.647475    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:18:36.538411 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:18:36.538373    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:18:38.454036 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:18:38.453989    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:18:45.945595 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:18:45.945551    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:18:48.638457 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:18:48.638420    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:18:54.139408 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:18:54.139370    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:18:59.209843 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:18:59.209810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:02.105516 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:02.105456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:02.205022 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:02.204986    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:02.565133 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:02.565051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:04.139050 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:04.139014    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:19:08.408388 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:08.408352    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:08.513061 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:08.513020    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:08.649936 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:08.649905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:08.772287 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:08.772192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:09.832165 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:09.832125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:09.935422 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:09.935387    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:10.013935 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:10.013904    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:10.468938 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:10.468900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:10.571547 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:10.571510    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:10.921793 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:10.921754    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:12.064648 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:12.064613    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:19:14.766527 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:14.766452    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"]
Jul 12 22:19:14.767000 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:14.766796    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17596c7a-e53c-46f7-912f-b52893bd3476" containerName="cleanup"
Jul 12 22:19:14.767000 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:14.766810    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="17596c7a-e53c-46f7-912f-b52893bd3476" containerName="cleanup"
Jul 12 22:19:14.767000 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:14.766915    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="17596c7a-e53c-46f7-912f-b52893bd3476" containerName="cleanup"
Jul 12 22:19:14.770095 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:14.770079    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"
Jul 12 22:19:14.772851 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:14.772836    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 22:19:14.772912 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:14.772858    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:19:14.777807 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:14.777785    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"]
Jul 12 22:19:14.906770 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:14.906693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8666b07f-77b4-42f4-b313-d2a882784697-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj\" (UID: \"8666b07f-77b4-42f4-b313-d2a882784697\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"
Jul 12 22:19:15.008128 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:15.008079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8666b07f-77b4-42f4-b313-d2a882784697-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj\" (UID: \"8666b07f-77b4-42f4-b313-d2a882784697\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"
Jul 12 22:19:15.008802 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:15.008781    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8666b07f-77b4-42f4-b313-d2a882784697-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj\" (UID: \"8666b07f-77b4-42f4-b313-d2a882784697\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"
Jul 12 22:19:15.081634 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:15.081603    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"
Jul 12 22:19:15.215793 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:15.215766    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"]
Jul 12 22:19:15.218656 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:19:15.218630    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8666b07f_77b4_42f4_b313_d2a882784697.slice/crio-917fd49fe6b12e67981d056f2e505e2d0e725d36210d911e82068496fa3a3ffc WatchSource:0}: Error finding container 917fd49fe6b12e67981d056f2e505e2d0e725d36210d911e82068496fa3a3ffc: Status 404 returned error can't find the container with id 917fd49fe6b12e67981d056f2e505e2d0e725d36210d911e82068496fa3a3ffc
Jul 12 22:19:15.582654 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:15.582619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj" event={"ID":"8666b07f-77b4-42f4-b313-d2a882784697","Type":"ContainerStarted","Data":"0536801b7a929b472e7cce48a1eb731138967fb5cc455ed586c47f8e4d1b575b"}
Jul 12 22:19:15.582845 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:15.582676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj" event={"ID":"8666b07f-77b4-42f4-b313-d2a882784697","Type":"ContainerStarted","Data":"917fd49fe6b12e67981d056f2e505e2d0e725d36210d911e82068496fa3a3ffc"}
Jul 12 22:19:15.599722 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:15.599645    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj" podStartSLOduration=1.599629593 podStartE2EDuration="1.599629593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:19:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:19:15.598737813 +0000 UTC m=+1613.462424351" watchObservedRunningTime="2026-07-12 22:19:15.599629593 +0000 UTC m=+1613.463316103"
Jul 12 22:19:16.588975 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:16.588938    2581 generic.go:356] "Generic (PLEG): container finished" podID="8666b07f-77b4-42f4-b313-d2a882784697" containerID="0536801b7a929b472e7cce48a1eb731138967fb5cc455ed586c47f8e4d1b575b" exitCode=7
Jul 12 22:19:16.589368 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:16.589012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj" event={"ID":"8666b07f-77b4-42f4-b313-d2a882784697","Type":"ContainerDied","Data":"0536801b7a929b472e7cce48a1eb731138967fb5cc455ed586c47f8e4d1b575b"}
Jul 12 22:19:16.589368 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:16.589208    2581 scope.go:117] "RemoveContainer" containerID="0536801b7a929b472e7cce48a1eb731138967fb5cc455ed586c47f8e4d1b575b"
Jul 12 22:19:17.535344 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:17.535257    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:19:17.595771 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:17.595739    2581 generic.go:356] "Generic (PLEG): container finished" podID="8666b07f-77b4-42f4-b313-d2a882784697" containerID="c33874861950e0420c0ebd822ca472593c733a882764cb72ef8484eede0f676a" exitCode=7
Jul 12 22:19:17.596199 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:17.595778    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj" event={"ID":"8666b07f-77b4-42f4-b313-d2a882784697","Type":"ContainerDied","Data":"c33874861950e0420c0ebd822ca472593c733a882764cb72ef8484eede0f676a"}
Jul 12 22:19:17.596199 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:17.595826    2581 scope.go:117] "RemoveContainer" containerID="0536801b7a929b472e7cce48a1eb731138967fb5cc455ed586c47f8e4d1b575b"
Jul 12 22:19:17.596199 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:17.596030    2581 scope.go:117] "RemoveContainer" containerID="c33874861950e0420c0ebd822ca472593c733a882764cb72ef8484eede0f676a"
Jul 12 22:19:17.596328 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:19:17.596264    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj_odh-ai-gateway-infra(8666b07f-77b4-42f4-b313-d2a882784697)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj" podUID="8666b07f-77b4-42f4-b313-d2a882784697"
Jul 12 22:19:18.602386 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:18.602364    2581 scope.go:117] "RemoveContainer" containerID="c33874861950e0420c0ebd822ca472593c733a882764cb72ef8484eede0f676a"
Jul 12 22:19:18.602742 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:19:18.602555    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj_odh-ai-gateway-infra(8666b07f-77b4-42f4-b313-d2a882784697)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj" podUID="8666b07f-77b4-42f4-b313-d2a882784697"
Jul 12 22:19:28.663907 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:28.663874    2581 scope.go:117] "RemoveContainer" containerID="c33874861950e0420c0ebd822ca472593c733a882764cb72ef8484eede0f676a"
Jul 12 22:19:29.655024 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:29.654929    2581 generic.go:356] "Generic (PLEG): container finished" podID="8666b07f-77b4-42f4-b313-d2a882784697" containerID="7b830c10a738ce2f1cbc2e74dad9daf53af23f8ddefee0c1648d1355eadfdf61" exitCode=0
Jul 12 22:19:29.655024 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:29.655005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj" event={"ID":"8666b07f-77b4-42f4-b313-d2a882784697","Type":"ContainerDied","Data":"7b830c10a738ce2f1cbc2e74dad9daf53af23f8ddefee0c1648d1355eadfdf61"}
Jul 12 22:19:29.655235 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:29.655083    2581 scope.go:117] "RemoveContainer" containerID="c33874861950e0420c0ebd822ca472593c733a882764cb72ef8484eede0f676a"
Jul 12 22:19:30.687479 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:30.687447    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"]
Jul 12 22:19:30.795648 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:30.795623    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"
Jul 12 22:19:30.846954 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:30.846916    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8666b07f-77b4-42f4-b313-d2a882784697-maas-api-service-ca\") pod \"8666b07f-77b4-42f4-b313-d2a882784697\" (UID: \"8666b07f-77b4-42f4-b313-d2a882784697\") "
Jul 12 22:19:30.847296 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:30.847270    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8666b07f-77b4-42f4-b313-d2a882784697-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8666b07f-77b4-42f4-b313-d2a882784697" (UID: "8666b07f-77b4-42f4-b313-d2a882784697"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:19:30.948531 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:30.948441    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8666b07f-77b4-42f4-b313-d2a882784697-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:19:31.666813 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:31.666776    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj" event={"ID":"8666b07f-77b4-42f4-b313-d2a882784697","Type":"ContainerDied","Data":"917fd49fe6b12e67981d056f2e505e2d0e725d36210d911e82068496fa3a3ffc"}
Jul 12 22:19:31.666813 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:31.666811    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"
Jul 12 22:19:31.667029 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:31.666823    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="917fd49fe6b12e67981d056f2e505e2d0e725d36210d911e82068496fa3a3ffc"
Jul 12 22:19:31.699679 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:31.699644    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"]
Jul 12 22:19:31.702795 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:31.702760    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-bczpj"]
Jul 12 22:19:32.670080 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:19:32.670043    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8666b07f-77b4-42f4-b313-d2a882784697" path="/var/lib/kubelet/pods/8666b07f-77b4-42f4-b313-d2a882784697/volumes"
Jul 12 22:20:04.808802 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.808772    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq"]
Jul 12 22:20:04.809389 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.809267    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8666b07f-77b4-42f4-b313-d2a882784697" containerName="revoke-keys"
Jul 12 22:20:04.809389 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.809286    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8666b07f-77b4-42f4-b313-d2a882784697" containerName="revoke-keys"
Jul 12 22:20:04.809389 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.809301    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8666b07f-77b4-42f4-b313-d2a882784697" containerName="revoke-keys"
Jul 12 22:20:04.809389 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.809309    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8666b07f-77b4-42f4-b313-d2a882784697" containerName="revoke-keys"
Jul 12 22:20:04.809389 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.809324    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8666b07f-77b4-42f4-b313-d2a882784697" containerName="revoke-keys"
Jul 12 22:20:04.809389 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.809333    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8666b07f-77b4-42f4-b313-d2a882784697" containerName="revoke-keys"
Jul 12 22:20:04.809729 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.809419    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8666b07f-77b4-42f4-b313-d2a882784697" containerName="revoke-keys"
Jul 12 22:20:04.809729 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.809432    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8666b07f-77b4-42f4-b313-d2a882784697" containerName="revoke-keys"
Jul 12 22:20:04.812337 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.812318    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq"
Jul 12 22:20:04.814999 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.814974    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 22:20:04.815104 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.815031    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:20:04.820691 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.820656    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq"]
Jul 12 22:20:04.863791 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.863752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024411b5-3a6a-4fcf-852a-42ce06a025ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq\" (UID: \"024411b5-3a6a-4fcf-852a-42ce06a025ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq"
Jul 12 22:20:04.964998 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.964953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024411b5-3a6a-4fcf-852a-42ce06a025ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq\" (UID: \"024411b5-3a6a-4fcf-852a-42ce06a025ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq"
Jul 12 22:20:04.965581 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:04.965562    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024411b5-3a6a-4fcf-852a-42ce06a025ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq\" (UID: \"024411b5-3a6a-4fcf-852a-42ce06a025ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq"
Jul 12 22:20:05.123844 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:05.123795    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq"
Jul 12 22:20:05.254823 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:05.254798    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq"]
Jul 12 22:20:05.257141 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:20:05.257111    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024411b5_3a6a_4fcf_852a_42ce06a025ca.slice/crio-06d740427fb8a5955946cf2072f0ba0d63550f7d76972bdd93efd3f27dc9b86c WatchSource:0}: Error finding container 06d740427fb8a5955946cf2072f0ba0d63550f7d76972bdd93efd3f27dc9b86c: Status 404 returned error can't find the container with id 06d740427fb8a5955946cf2072f0ba0d63550f7d76972bdd93efd3f27dc9b86c
Jul 12 22:20:05.813197 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:05.813107    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq" event={"ID":"024411b5-3a6a-4fcf-852a-42ce06a025ca","Type":"ContainerStarted","Data":"b46ab428361346dc0794dc0f57f5362dead07ed72288e5cef593c2eae699c2ad"}
Jul 12 22:20:05.813197 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:05.813169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq" event={"ID":"024411b5-3a6a-4fcf-852a-42ce06a025ca","Type":"ContainerStarted","Data":"06d740427fb8a5955946cf2072f0ba0d63550f7d76972bdd93efd3f27dc9b86c"}
Jul 12 22:20:05.829177 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:05.829127    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq" podStartSLOduration=1.829111441 podStartE2EDuration="1.829111441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:20:05.82818425 +0000 UTC m=+1663.691870776" watchObservedRunningTime="2026-07-12 22:20:05.829111441 +0000 UTC m=+1663.692797954"
Jul 12 22:20:06.819122 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:06.819089    2581 generic.go:356] "Generic (PLEG): container finished" podID="024411b5-3a6a-4fcf-852a-42ce06a025ca" containerID="b46ab428361346dc0794dc0f57f5362dead07ed72288e5cef593c2eae699c2ad" exitCode=0
Jul 12 22:20:06.819531 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:06.819157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq" event={"ID":"024411b5-3a6a-4fcf-852a-42ce06a025ca","Type":"ContainerDied","Data":"b46ab428361346dc0794dc0f57f5362dead07ed72288e5cef593c2eae699c2ad"}
Jul 12 22:20:07.955325 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:07.955297    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq"
Jul 12 22:20:07.991487 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:07.991456    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024411b5-3a6a-4fcf-852a-42ce06a025ca-maas-api-service-ca\") pod \"024411b5-3a6a-4fcf-852a-42ce06a025ca\" (UID: \"024411b5-3a6a-4fcf-852a-42ce06a025ca\") "
Jul 12 22:20:07.991817 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:07.991795    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/024411b5-3a6a-4fcf-852a-42ce06a025ca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "024411b5-3a6a-4fcf-852a-42ce06a025ca" (UID: "024411b5-3a6a-4fcf-852a-42ce06a025ca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:20:08.092751 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:08.092718    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/024411b5-3a6a-4fcf-852a-42ce06a025ca-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:20:08.828836 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:08.828803    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq"
Jul 12 22:20:08.829011 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:08.828810    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq" event={"ID":"024411b5-3a6a-4fcf-852a-42ce06a025ca","Type":"ContainerDied","Data":"06d740427fb8a5955946cf2072f0ba0d63550f7d76972bdd93efd3f27dc9b86c"}
Jul 12 22:20:08.829011 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:08.828931    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06d740427fb8a5955946cf2072f0ba0d63550f7d76972bdd93efd3f27dc9b86c"
Jul 12 22:20:15.516645 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:15.516607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:18.167372 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:18.167336    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:20:19.897665 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:19.897629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:25.795169 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:25.795132    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:25.898089 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:25.898056    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:30.093299 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:30.093258    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:30.454980 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:30.454885    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:30.567196 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:30.567161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:30.781926 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:30.781848    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:31.902891 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.902856    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:31.980212 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.980182    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"]
Jul 12 22:20:31.980615 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.980594    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="024411b5-3a6a-4fcf-852a-42ce06a025ca" containerName="revoke-keys"
Jul 12 22:20:31.980615 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.980614    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="024411b5-3a6a-4fcf-852a-42ce06a025ca" containerName="revoke-keys"
Jul 12 22:20:31.980793 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.980733    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="024411b5-3a6a-4fcf-852a-42ce06a025ca" containerName="revoke-keys"
Jul 12 22:20:31.980793 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.980743    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8666b07f-77b4-42f4-b313-d2a882784697" containerName="revoke-keys"
Jul 12 22:20:31.983776 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.983755    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:31.986593 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.986560    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f4rcr\""
Jul 12 22:20:31.986708 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.986560    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-dccf31a6-serving-cert\""
Jul 12 22:20:31.987764 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.987743    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 22:20:31.987872 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.987770    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 22:20:31.997440 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:31.997416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"]
Jul 12 22:20:32.021877 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.021844    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:32.116268 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.116228    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50107b72-ba3a-483d-955d-0497650e3595-maas-api-tls\") pod \"maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:32.116455 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.116285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50107b72-ba3a-483d-955d-0497650e3595-openshift-service-ca\") pod \"maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:32.116455 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.116365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfh8t\" (UniqueName: \"kubernetes.io/projected/50107b72-ba3a-483d-955d-0497650e3595-kube-api-access-cfh8t\") pod \"maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:32.136516 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.136456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:32.217107 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.217026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfh8t\" (UniqueName: \"kubernetes.io/projected/50107b72-ba3a-483d-955d-0497650e3595-kube-api-access-cfh8t\") pod \"maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:32.217107 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.217088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50107b72-ba3a-483d-955d-0497650e3595-maas-api-tls\") pod \"maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:32.217305 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.217134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50107b72-ba3a-483d-955d-0497650e3595-openshift-service-ca\") pod \"maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:32.217773 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.217742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50107b72-ba3a-483d-955d-0497650e3595-openshift-service-ca\") pod \"maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:32.219537 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.219517    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50107b72-ba3a-483d-955d-0497650e3595-maas-api-tls\") pod \"maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:32.225764 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.225743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfh8t\" (UniqueName: \"kubernetes.io/projected/50107b72-ba3a-483d-955d-0497650e3595-kube-api-access-cfh8t\") pod \"maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:32.293831 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.293795    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:32.427130 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.427099    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"]
Jul 12 22:20:32.430750 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:20:32.430719    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50107b72_ba3a_483d_955d_0497650e3595.slice/crio-e3d49fb9816344d7639970fa982ae1134464cc89c28e3089aaa3a314fe37ad47 WatchSource:0}: Error finding container e3d49fb9816344d7639970fa982ae1134464cc89c28e3089aaa3a314fe37ad47: Status 404 returned error can't find the container with id e3d49fb9816344d7639970fa982ae1134464cc89c28e3089aaa3a314fe37ad47
Jul 12 22:20:32.432183 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.432162    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 22:20:32.571382 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.569329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:32.669911 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.669880    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:32.938271 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:32.938233    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22" event={"ID":"50107b72-ba3a-483d-955d-0497650e3595","Type":"ContainerStarted","Data":"e3d49fb9816344d7639970fa982ae1134464cc89c28e3089aaa3a314fe37ad47"}
Jul 12 22:20:34.953642 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:34.953600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22" event={"ID":"50107b72-ba3a-483d-955d-0497650e3595","Type":"ContainerStarted","Data":"55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc"}
Jul 12 22:20:34.954066 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:34.953826    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:34.974535 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:34.974487    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22" podStartSLOduration=2.3915220010000002 podStartE2EDuration="3.974471565s" totalImagesPullingTime="1.582949564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:20:34.972495441 +0000 UTC m=+1692.836181978" watchObservedRunningTime="2026-07-12 22:20:34.974471565 +0000 UTC m=+1692.838158078"
Jul 12 22:20:36.417430 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:36.417395    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"]
Jul 12 22:20:36.420859 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:36.420842    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"
Jul 12 22:20:36.423516 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:36.423493    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:20:36.429711 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:36.429670    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"]
Jul 12 22:20:36.557557 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:36.557516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ca19e00-683c-4f60-9726-bd18d64704a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn\" (UID: \"8ca19e00-683c-4f60-9726-bd18d64704a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"
Jul 12 22:20:36.658910 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:36.658873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ca19e00-683c-4f60-9726-bd18d64704a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn\" (UID: \"8ca19e00-683c-4f60-9726-bd18d64704a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"
Jul 12 22:20:36.659811 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:36.659789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ca19e00-683c-4f60-9726-bd18d64704a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn\" (UID: \"8ca19e00-683c-4f60-9726-bd18d64704a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"
Jul 12 22:20:36.732197 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:36.732109    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"
Jul 12 22:20:36.863267 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:36.863241    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"]
Jul 12 22:20:36.865281 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:20:36.865250    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca19e00_683c_4f60_9726_bd18d64704a7.slice/crio-473485746d62083c72e67c5a0d56e319cd074c0145e53d65e3a304635dc14c6c WatchSource:0}: Error finding container 473485746d62083c72e67c5a0d56e319cd074c0145e53d65e3a304635dc14c6c: Status 404 returned error can't find the container with id 473485746d62083c72e67c5a0d56e319cd074c0145e53d65e3a304635dc14c6c
Jul 12 22:20:36.963426 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:36.963390    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn" event={"ID":"8ca19e00-683c-4f60-9726-bd18d64704a7","Type":"ContainerStarted","Data":"473485746d62083c72e67c5a0d56e319cd074c0145e53d65e3a304635dc14c6c"}
Jul 12 22:20:37.969382 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:37.969348    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerID="0af5013707afbebda86a04e99440676c9b7ef8623b9579d6d518cf3ce9a87281" exitCode=7
Jul 12 22:20:37.969770 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:37.969429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn" event={"ID":"8ca19e00-683c-4f60-9726-bd18d64704a7","Type":"ContainerDied","Data":"0af5013707afbebda86a04e99440676c9b7ef8623b9579d6d518cf3ce9a87281"}
Jul 12 22:20:37.969770 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:37.969578    2581 scope.go:117] "RemoveContainer" containerID="0af5013707afbebda86a04e99440676c9b7ef8623b9579d6d518cf3ce9a87281"
Jul 12 22:20:38.976548 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:38.976515    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerID="febe6e1ecc27ef6b8ee880777f0f03ab5d5bcc0e1a5d5375a3b492c50053076a" exitCode=7
Jul 12 22:20:38.976967 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:38.976604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn" event={"ID":"8ca19e00-683c-4f60-9726-bd18d64704a7","Type":"ContainerDied","Data":"febe6e1ecc27ef6b8ee880777f0f03ab5d5bcc0e1a5d5375a3b492c50053076a"}
Jul 12 22:20:38.976967 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:38.976663    2581 scope.go:117] "RemoveContainer" containerID="0af5013707afbebda86a04e99440676c9b7ef8623b9579d6d518cf3ce9a87281"
Jul 12 22:20:38.976967 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:38.976866    2581 scope.go:117] "RemoveContainer" containerID="febe6e1ecc27ef6b8ee880777f0f03ab5d5bcc0e1a5d5375a3b492c50053076a"
Jul 12 22:20:38.977105 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:20:38.977087    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn_odh-ai-gateway-infra(8ca19e00-683c-4f60-9726-bd18d64704a7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7"
Jul 12 22:20:39.438292 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:39.438253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:20:39.983283 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:39.983256    2581 scope.go:117] "RemoveContainer" containerID="febe6e1ecc27ef6b8ee880777f0f03ab5d5bcc0e1a5d5375a3b492c50053076a"
Jul 12 22:20:39.983652 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:20:39.983424    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn_odh-ai-gateway-infra(8ca19e00-683c-4f60-9726-bd18d64704a7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7"
Jul 12 22:20:40.963180 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:40.963144    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:20:46.822337 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:46.822298    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:46.881977 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:46.881927    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:50.117512 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:50.117481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:20:54.664138 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:54.664107    2581 scope.go:117] "RemoveContainer" containerID="febe6e1ecc27ef6b8ee880777f0f03ab5d5bcc0e1a5d5375a3b492c50053076a"
Jul 12 22:20:55.052762 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:55.052724    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn" event={"ID":"8ca19e00-683c-4f60-9726-bd18d64704a7","Type":"ContainerStarted","Data":"f4736c207bace3c9042816bd2ed7c5f5fc2b48832e4de9e6c0a81091e27deceb"}
Jul 12 22:20:55.072267 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:55.072214    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn" podStartSLOduration=19.072197487 podStartE2EDuration="19.072197487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:20:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:20:55.070250197 +0000 UTC m=+1712.933936733" watchObservedRunningTime="2026-07-12 22:20:55.072197487 +0000 UTC m=+1712.935884000"
Jul 12 22:20:56.059262 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:56.059229    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerID="f4736c207bace3c9042816bd2ed7c5f5fc2b48832e4de9e6c0a81091e27deceb" exitCode=0
Jul 12 22:20:56.059692 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:56.059290    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn" event={"ID":"8ca19e00-683c-4f60-9726-bd18d64704a7","Type":"ContainerDied","Data":"f4736c207bace3c9042816bd2ed7c5f5fc2b48832e4de9e6c0a81091e27deceb"}
Jul 12 22:20:56.059692 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:56.059344    2581 scope.go:117] "RemoveContainer" containerID="febe6e1ecc27ef6b8ee880777f0f03ab5d5bcc0e1a5d5375a3b492c50053076a"
Jul 12 22:20:56.082167 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:56.082139    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"]
Jul 12 22:20:57.198123 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:57.198095    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"
Jul 12 22:20:57.249915 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:57.249878    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ca19e00-683c-4f60-9726-bd18d64704a7-maas-api-service-ca\") pod \"8ca19e00-683c-4f60-9726-bd18d64704a7\" (UID: \"8ca19e00-683c-4f60-9726-bd18d64704a7\") "
Jul 12 22:20:57.250270 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:57.250244    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ca19e00-683c-4f60-9726-bd18d64704a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8ca19e00-683c-4f60-9726-bd18d64704a7" (UID: "8ca19e00-683c-4f60-9726-bd18d64704a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:20:57.351502 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:57.351465    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ca19e00-683c-4f60-9726-bd18d64704a7-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:20:58.070801 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:58.070766    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn" event={"ID":"8ca19e00-683c-4f60-9726-bd18d64704a7","Type":"ContainerDied","Data":"473485746d62083c72e67c5a0d56e319cd074c0145e53d65e3a304635dc14c6c"}
Jul 12 22:20:58.070801 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:58.070795    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"
Jul 12 22:20:58.071054 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:58.070822    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="473485746d62083c72e67c5a0d56e319cd074c0145e53d65e3a304635dc14c6c"
Jul 12 22:20:58.103674 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:58.103643    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"]
Jul 12 22:20:58.113767 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:58.111311    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-tttsn"]
Jul 12 22:20:58.668270 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:20:58.668239    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7" path="/var/lib/kubelet/pods/8ca19e00-683c-4f60-9726-bd18d64704a7/volumes"
Jul 12 22:21:36.467959 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.467913    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl"]
Jul 12 22:21:36.468479 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.468456    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerName="revoke-keys"
Jul 12 22:21:36.468479 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.468471    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerName="revoke-keys"
Jul 12 22:21:36.468479 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.468478    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerName="revoke-keys"
Jul 12 22:21:36.468639 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.468485    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerName="revoke-keys"
Jul 12 22:21:36.468639 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.468584    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerName="revoke-keys"
Jul 12 22:21:36.468639 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.468595    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerName="revoke-keys"
Jul 12 22:21:36.468639 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.468601    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerName="revoke-keys"
Jul 12 22:21:36.472252 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.472222    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl"
Jul 12 22:21:36.475159 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.475137    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:21:36.482652 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.482623    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl"]
Jul 12 22:21:36.496506 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.496473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl\" (UID: \"d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl"
Jul 12 22:21:36.564544 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.564501    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:36.597670 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.597628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl\" (UID: \"d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl"
Jul 12 22:21:36.598323 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.598302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl\" (UID: \"d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl"
Jul 12 22:21:36.671932 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.671899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:36.786023 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:36.785945    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl"
Jul 12 22:21:37.126612 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:37.126578    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl"]
Jul 12 22:21:37.129848 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:21:37.129814    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d9d70a_7d7e_40ff_8a6b_d8ba602338bd.slice/crio-077d52a5b6b0270ac809daf5f18e0eb98ff4860df67b2e179c34178d75c5e570 WatchSource:0}: Error finding container 077d52a5b6b0270ac809daf5f18e0eb98ff4860df67b2e179c34178d75c5e570: Status 404 returned error can't find the container with id 077d52a5b6b0270ac809daf5f18e0eb98ff4860df67b2e179c34178d75c5e570
Jul 12 22:21:37.250944 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:37.250911    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl" event={"ID":"d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd","Type":"ContainerStarted","Data":"077d52a5b6b0270ac809daf5f18e0eb98ff4860df67b2e179c34178d75c5e570"}
Jul 12 22:21:38.256448 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:38.256418    2581 generic.go:356] "Generic (PLEG): container finished" podID="d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd" containerID="f4e4574dd0d8db86982996e7915517d420e9865ea25c405baf3863fffadff3d2" exitCode=0
Jul 12 22:21:38.256846 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:38.256499    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl" event={"ID":"d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd","Type":"ContainerDied","Data":"f4e4574dd0d8db86982996e7915517d420e9865ea25c405baf3863fffadff3d2"}
Jul 12 22:21:39.394137 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:39.394111    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl"
Jul 12 22:21:39.422212 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:39.422186    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd-maas-api-service-ca\") pod \"d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd\" (UID: \"d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd\") "
Jul 12 22:21:39.422531 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:39.422510    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd" (UID: "d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:21:39.442349 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:39.442315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:21:39.523482 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:39.523382    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:21:40.267403 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:40.267376    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl"
Jul 12 22:21:40.267403 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:40.267381    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl" event={"ID":"d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd","Type":"ContainerDied","Data":"077d52a5b6b0270ac809daf5f18e0eb98ff4860df67b2e179c34178d75c5e570"}
Jul 12 22:21:40.267610 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:40.267463    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="077d52a5b6b0270ac809daf5f18e0eb98ff4860df67b2e179c34178d75c5e570"
Jul 12 22:21:41.717056 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:41.717024    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"]
Jul 12 22:21:41.717501 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:41.717306    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22" podUID="50107b72-ba3a-483d-955d-0497650e3595" containerName="maas-api" containerID="cri-o://55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc" gracePeriod=30
Jul 12 22:21:41.743691 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:41.743664    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:41.990464 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:41.990435    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:21:42.046386 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.046357    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50107b72-ba3a-483d-955d-0497650e3595-maas-api-tls\") pod \"50107b72-ba3a-483d-955d-0497650e3595\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") "
Jul 12 22:21:42.046588 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.046470    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfh8t\" (UniqueName: \"kubernetes.io/projected/50107b72-ba3a-483d-955d-0497650e3595-kube-api-access-cfh8t\") pod \"50107b72-ba3a-483d-955d-0497650e3595\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") "
Jul 12 22:21:42.046588 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.046524    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50107b72-ba3a-483d-955d-0497650e3595-openshift-service-ca\") pod \"50107b72-ba3a-483d-955d-0497650e3595\" (UID: \"50107b72-ba3a-483d-955d-0497650e3595\") "
Jul 12 22:21:42.046937 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.046909    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50107b72-ba3a-483d-955d-0497650e3595-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "50107b72-ba3a-483d-955d-0497650e3595" (UID: "50107b72-ba3a-483d-955d-0497650e3595"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:21:42.048594 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.048567    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50107b72-ba3a-483d-955d-0497650e3595-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "50107b72-ba3a-483d-955d-0497650e3595" (UID: "50107b72-ba3a-483d-955d-0497650e3595"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:21:42.048692 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.048591    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50107b72-ba3a-483d-955d-0497650e3595-kube-api-access-cfh8t" (OuterVolumeSpecName: "kube-api-access-cfh8t") pod "50107b72-ba3a-483d-955d-0497650e3595" (UID: "50107b72-ba3a-483d-955d-0497650e3595"). InnerVolumeSpecName "kube-api-access-cfh8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:21:42.147203 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.147165    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50107b72-ba3a-483d-955d-0497650e3595-openshift-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:21:42.147203 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.147197    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50107b72-ba3a-483d-955d-0497650e3595-maas-api-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:21:42.147203 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.147206    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfh8t\" (UniqueName: \"kubernetes.io/projected/50107b72-ba3a-483d-955d-0497650e3595-kube-api-access-cfh8t\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:21:42.277775 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.277667    2581 generic.go:356] "Generic (PLEG): container finished" podID="50107b72-ba3a-483d-955d-0497650e3595" containerID="55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc" exitCode=0
Jul 12 22:21:42.277775 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.277731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22" event={"ID":"50107b72-ba3a-483d-955d-0497650e3595","Type":"ContainerDied","Data":"55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc"}
Jul 12 22:21:42.277775 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.277741    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"
Jul 12 22:21:42.277990 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.277786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22" event={"ID":"50107b72-ba3a-483d-955d-0497650e3595","Type":"ContainerDied","Data":"e3d49fb9816344d7639970fa982ae1134464cc89c28e3089aaa3a314fe37ad47"}
Jul 12 22:21:42.277990 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.277816    2581 scope.go:117] "RemoveContainer" containerID="55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc"
Jul 12 22:21:42.286683 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.286666    2581 scope.go:117] "RemoveContainer" containerID="55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc"
Jul 12 22:21:42.286987 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:21:42.286966    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc\": container with ID starting with 55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc not found: ID does not exist" containerID="55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc"
Jul 12 22:21:42.287044 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.286996    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc"} err="failed to get container status \"55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc\": rpc error: code = NotFound desc = could not find container \"55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc\": container with ID starting with 55187c90bb635af3005ca0828c24a5a7a0e781f4ce3fec41a80eb82c756f89bc not found: ID does not exist"
Jul 12 22:21:42.299277 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.299251    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"]
Jul 12 22:21:42.303525 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.303502    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dccf31a6-dc78d958b-drp22"]
Jul 12 22:21:42.670715 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.670677    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50107b72-ba3a-483d-955d-0497650e3595" path="/var/lib/kubelet/pods/50107b72-ba3a-483d-955d-0497650e3595/volumes"
Jul 12 22:21:42.742857 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.742825    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:42.845186 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:42.845151    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:43.002481 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:43.002437    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:43.103074 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:43.103043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:43.203261 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:43.203162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:44.141330 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.141292    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:44.223362 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.223334    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:44.435532 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.435454    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"]
Jul 12 22:21:44.435821 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.435808    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd" containerName="revoke-keys"
Jul 12 22:21:44.435882 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.435822    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd" containerName="revoke-keys"
Jul 12 22:21:44.435882 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.435831    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerName="revoke-keys"
Jul 12 22:21:44.435882 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.435837    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca19e00-683c-4f60-9726-bd18d64704a7" containerName="revoke-keys"
Jul 12 22:21:44.435882 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.435846    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50107b72-ba3a-483d-955d-0497650e3595" containerName="maas-api"
Jul 12 22:21:44.435882 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.435852    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="50107b72-ba3a-483d-955d-0497650e3595" containerName="maas-api"
Jul 12 22:21:44.436033 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.435920    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd" containerName="revoke-keys"
Jul 12 22:21:44.436033 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.435930    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="50107b72-ba3a-483d-955d-0497650e3595" containerName="maas-api"
Jul 12 22:21:44.440195 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.440176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:44.445048 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.445029    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-92b395e7-serving-cert\""
Jul 12 22:21:44.446249 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.446220    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 22:21:44.446368 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.446351    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f4rcr\""
Jul 12 22:21:44.449730 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.449710    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 22:21:44.469942 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.469914    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"]
Jul 12 22:21:44.470255 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.470237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb6cv\" (UniqueName: \"kubernetes.io/projected/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-kube-api-access-kb6cv\") pod \"maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:44.470320 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.470302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-openshift-service-ca\") pod \"maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:44.470357 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.470333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-maas-api-tls\") pod \"maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:44.489536 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.489509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:44.570990 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.570954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb6cv\" (UniqueName: \"kubernetes.io/projected/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-kube-api-access-kb6cv\") pod \"maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:44.571185 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.571017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-openshift-service-ca\") pod \"maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:44.571185 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.571127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-maas-api-tls\") pod \"maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:44.571908 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.571884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-openshift-service-ca\") pod \"maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:44.573622 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.573598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-maas-api-tls\") pod \"maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:44.589583 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.589550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb6cv\" (UniqueName: \"kubernetes.io/projected/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-kube-api-access-kb6cv\") pod \"maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:44.647960 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.647924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:44.749990 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.749902    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:44.889468 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:44.889421    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"]
Jul 12 22:21:44.891823 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:21:44.891796    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd9ee6e_3a48_4a0b_94c4_4149b8753e6a.slice/crio-b5b1d8f683a32a16f74245333e8a720d6260a39330387d1483802526786a71eb WatchSource:0}: Error finding container b5b1d8f683a32a16f74245333e8a720d6260a39330387d1483802526786a71eb: Status 404 returned error can't find the container with id b5b1d8f683a32a16f74245333e8a720d6260a39330387d1483802526786a71eb
Jul 12 22:21:45.038275 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:45.038197    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:45.138262 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:45.138228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:45.293644 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:45.293566    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs" event={"ID":"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a","Type":"ContainerStarted","Data":"b5b1d8f683a32a16f74245333e8a720d6260a39330387d1483802526786a71eb"}
Jul 12 22:21:46.299383 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:46.299348    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs" event={"ID":"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a","Type":"ContainerStarted","Data":"8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4"}
Jul 12 22:21:46.299801 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:46.299477    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:46.323353 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:46.323304    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs" podStartSLOduration=1.83126509 podStartE2EDuration="2.32328506s" totalImagesPullingTime="492.01997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:21:46.322298091 +0000 UTC m=+1764.185984604" watchObservedRunningTime="2026-07-12 22:21:46.32328506 +0000 UTC m=+1764.186971565"
Jul 12 22:21:46.467602 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:46.467568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:21:47.441121 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:47.441082    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:21:49.142512 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:49.142472    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"]
Jul 12 22:21:49.146102 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:49.146080    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"
Jul 12 22:21:49.148987 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:49.148966    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:21:49.154184 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:49.154164    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"]
Jul 12 22:21:49.216462 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:49.216416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fb6cc9-10a3-4b40-9586-87c89645a65e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz\" (UID: \"c8fb6cc9-10a3-4b40-9586-87c89645a65e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"
Jul 12 22:21:49.317614 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:49.317585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fb6cc9-10a3-4b40-9586-87c89645a65e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz\" (UID: \"c8fb6cc9-10a3-4b40-9586-87c89645a65e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"
Jul 12 22:21:49.318286 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:49.318266    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fb6cc9-10a3-4b40-9586-87c89645a65e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz\" (UID: \"c8fb6cc9-10a3-4b40-9586-87c89645a65e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"
Jul 12 22:21:49.458146 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:49.458064    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"
Jul 12 22:21:49.613166 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:49.613139    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"]
Jul 12 22:21:49.615603 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:21:49.615576    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8fb6cc9_10a3_4b40_9586_87c89645a65e.slice/crio-ae39094537fed8ba658af7daa11dfc4e64a5eaef58a329e8f1f85309b629f036 WatchSource:0}: Error finding container ae39094537fed8ba658af7daa11dfc4e64a5eaef58a329e8f1f85309b629f036: Status 404 returned error can't find the container with id ae39094537fed8ba658af7daa11dfc4e64a5eaef58a329e8f1f85309b629f036
Jul 12 22:21:50.319568 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:50.319534    2581 generic.go:356] "Generic (PLEG): container finished" podID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerID="fb787c8bf1177d63348149045c1135c80eeb5c8383100d6d298dc75b806b4455" exitCode=7
Jul 12 22:21:50.319996 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:50.319625    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz" event={"ID":"c8fb6cc9-10a3-4b40-9586-87c89645a65e","Type":"ContainerDied","Data":"fb787c8bf1177d63348149045c1135c80eeb5c8383100d6d298dc75b806b4455"}
Jul 12 22:21:50.319996 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:50.319677    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz" event={"ID":"c8fb6cc9-10a3-4b40-9586-87c89645a65e","Type":"ContainerStarted","Data":"ae39094537fed8ba658af7daa11dfc4e64a5eaef58a329e8f1f85309b629f036"}
Jul 12 22:21:50.319996 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:50.319806    2581 scope.go:117] "RemoveContainer" containerID="fb787c8bf1177d63348149045c1135c80eeb5c8383100d6d298dc75b806b4455"
Jul 12 22:21:51.326119 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:51.326020    2581 generic.go:356] "Generic (PLEG): container finished" podID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerID="8b8a2581cae1dfcbb8cf10eabb525f201bfbe26b556a8b6506700f1e45051382" exitCode=7
Jul 12 22:21:51.326549 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:51.326110    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz" event={"ID":"c8fb6cc9-10a3-4b40-9586-87c89645a65e","Type":"ContainerDied","Data":"8b8a2581cae1dfcbb8cf10eabb525f201bfbe26b556a8b6506700f1e45051382"}
Jul 12 22:21:51.326549 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:51.326180    2581 scope.go:117] "RemoveContainer" containerID="fb787c8bf1177d63348149045c1135c80eeb5c8383100d6d298dc75b806b4455"
Jul 12 22:21:51.326549 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:51.326401    2581 scope.go:117] "RemoveContainer" containerID="8b8a2581cae1dfcbb8cf10eabb525f201bfbe26b556a8b6506700f1e45051382"
Jul 12 22:21:51.326755 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:21:51.326608    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz_odh-ai-gateway-infra(c8fb6cc9-10a3-4b40-9586-87c89645a65e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e"
Jul 12 22:21:52.309612 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:52.309582    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:21:52.331891 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:21:52.331863    2581 scope.go:117] "RemoveContainer" containerID="8b8a2581cae1dfcbb8cf10eabb525f201bfbe26b556a8b6506700f1e45051382"
Jul 12 22:21:52.332414 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:21:52.332120    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz_odh-ai-gateway-infra(c8fb6cc9-10a3-4b40-9586-87c89645a65e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e"
Jul 12 22:22:07.664095 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:07.664063    2581 scope.go:117] "RemoveContainer" containerID="8b8a2581cae1dfcbb8cf10eabb525f201bfbe26b556a8b6506700f1e45051382"
Jul 12 22:22:08.406407 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:08.406376    2581 generic.go:356] "Generic (PLEG): container finished" podID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerID="9796b70556fb7eb85978f8e1009e9401224a4ba3ce83e8b9edd6c6d9b288bc28" exitCode=0
Jul 12 22:22:08.406563 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:08.406454    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz" event={"ID":"c8fb6cc9-10a3-4b40-9586-87c89645a65e","Type":"ContainerDied","Data":"9796b70556fb7eb85978f8e1009e9401224a4ba3ce83e8b9edd6c6d9b288bc28"}
Jul 12 22:22:08.406563 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:08.406532    2581 scope.go:117] "RemoveContainer" containerID="8b8a2581cae1dfcbb8cf10eabb525f201bfbe26b556a8b6506700f1e45051382"
Jul 12 22:22:09.440143 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:09.440108    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"]
Jul 12 22:22:09.543360 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:09.543338    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"
Jul 12 22:22:09.695073 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:09.694987    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fb6cc9-10a3-4b40-9586-87c89645a65e-maas-api-service-ca\") pod \"c8fb6cc9-10a3-4b40-9586-87c89645a65e\" (UID: \"c8fb6cc9-10a3-4b40-9586-87c89645a65e\") "
Jul 12 22:22:09.695349 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:09.695321    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8fb6cc9-10a3-4b40-9586-87c89645a65e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8fb6cc9-10a3-4b40-9586-87c89645a65e" (UID: "c8fb6cc9-10a3-4b40-9586-87c89645a65e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:22:09.796391 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:09.796355    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8fb6cc9-10a3-4b40-9586-87c89645a65e-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:22:10.408244 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:10.408210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:22:10.419318 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:10.419287    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz" event={"ID":"c8fb6cc9-10a3-4b40-9586-87c89645a65e","Type":"ContainerDied","Data":"ae39094537fed8ba658af7daa11dfc4e64a5eaef58a329e8f1f85309b629f036"}
Jul 12 22:22:10.419318 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:10.419305    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"
Jul 12 22:22:10.419499 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:10.419332    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae39094537fed8ba658af7daa11dfc4e64a5eaef58a329e8f1f85309b629f036"
Jul 12 22:22:10.475099 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:10.475067    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"]
Jul 12 22:22:10.480511 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:10.480482    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-6mlcz"]
Jul 12 22:22:10.567972 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:10.567934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:22:10.668900 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:10.668817    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" path="/var/lib/kubelet/pods/c8fb6cc9-10a3-4b40-9586-87c89645a65e/volumes"
Jul 12 22:22:19.701850 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:19.701810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:22:19.800458 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:19.800420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:22:22.660399 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:22.660374    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:22:22.663809 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:22.663783    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:22:27.532082 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:27.532029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:22:49.184562 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.184525    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp"]
Jul 12 22:22:49.184980 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.184879    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerName="revoke-keys"
Jul 12 22:22:49.184980 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.184891    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerName="revoke-keys"
Jul 12 22:22:49.184980 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.184906    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerName="revoke-keys"
Jul 12 22:22:49.184980 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.184912    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerName="revoke-keys"
Jul 12 22:22:49.184980 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.184973    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerName="revoke-keys"
Jul 12 22:22:49.184980 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.184982    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerName="revoke-keys"
Jul 12 22:22:49.188007 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.187990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp"
Jul 12 22:22:49.190685 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.190662    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:22:49.195635 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.195614    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp"]
Jul 12 22:22:49.245847 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.245814    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e10fe9a-a139-47c9-952c-2ae0c1bf2642-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp\" (UID: \"0e10fe9a-a139-47c9-952c-2ae0c1bf2642\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp"
Jul 12 22:22:49.346490 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.346450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e10fe9a-a139-47c9-952c-2ae0c1bf2642-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp\" (UID: \"0e10fe9a-a139-47c9-952c-2ae0c1bf2642\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp"
Jul 12 22:22:49.347130 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.347111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e10fe9a-a139-47c9-952c-2ae0c1bf2642-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp\" (UID: \"0e10fe9a-a139-47c9-952c-2ae0c1bf2642\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp"
Jul 12 22:22:49.499301 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.499200    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp"
Jul 12 22:22:49.634936 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:49.634908    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp"]
Jul 12 22:22:49.637244 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:22:49.637219    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e10fe9a_a139_47c9_952c_2ae0c1bf2642.slice/crio-7ab56f3baf6502ee4d9d702d9f2527986b371fe9c56e4dcda859ac4b1a2148b4 WatchSource:0}: Error finding container 7ab56f3baf6502ee4d9d702d9f2527986b371fe9c56e4dcda859ac4b1a2148b4: Status 404 returned error can't find the container with id 7ab56f3baf6502ee4d9d702d9f2527986b371fe9c56e4dcda859ac4b1a2148b4
Jul 12 22:22:50.607030 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:50.606998    2581 generic.go:356] "Generic (PLEG): container finished" podID="0e10fe9a-a139-47c9-952c-2ae0c1bf2642" containerID="c0fbe2db39814275fcda4466240441059be8d98497c591e9da96de855acbf281" exitCode=0
Jul 12 22:22:50.607479 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:50.607089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp" event={"ID":"0e10fe9a-a139-47c9-952c-2ae0c1bf2642","Type":"ContainerDied","Data":"c0fbe2db39814275fcda4466240441059be8d98497c591e9da96de855acbf281"}
Jul 12 22:22:50.607479 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:50.607170    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp" event={"ID":"0e10fe9a-a139-47c9-952c-2ae0c1bf2642","Type":"ContainerStarted","Data":"7ab56f3baf6502ee4d9d702d9f2527986b371fe9c56e4dcda859ac4b1a2148b4"}
Jul 12 22:22:51.740203 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:51.740174    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp"
Jul 12 22:22:51.874281 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:51.874200    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e10fe9a-a139-47c9-952c-2ae0c1bf2642-maas-api-service-ca\") pod \"0e10fe9a-a139-47c9-952c-2ae0c1bf2642\" (UID: \"0e10fe9a-a139-47c9-952c-2ae0c1bf2642\") "
Jul 12 22:22:51.874565 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:51.874543    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e10fe9a-a139-47c9-952c-2ae0c1bf2642-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0e10fe9a-a139-47c9-952c-2ae0c1bf2642" (UID: "0e10fe9a-a139-47c9-952c-2ae0c1bf2642"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:22:51.975879 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:51.975844    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e10fe9a-a139-47c9-952c-2ae0c1bf2642-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:22:52.619173 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:52.619138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp" event={"ID":"0e10fe9a-a139-47c9-952c-2ae0c1bf2642","Type":"ContainerDied","Data":"7ab56f3baf6502ee4d9d702d9f2527986b371fe9c56e4dcda859ac4b1a2148b4"}
Jul 12 22:22:52.619344 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:52.619186    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp"
Jul 12 22:22:52.619344 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:52.619199    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ab56f3baf6502ee4d9d702d9f2527986b371fe9c56e4dcda859ac4b1a2148b4"
Jul 12 22:22:56.286022 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:56.285975    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:22:59.738094 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:59.738059    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"]
Jul 12 22:22:59.751597 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:22:59.751568    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-serving-cert: secret "maas-api-e2e-ait-92b395e7-serving-cert" not found
Jul 12 22:22:59.751781 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:22:59.751653    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-maas-api-tls podName:9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a nodeName:}" failed. No retries permitted until 2026-07-12 22:23:00.251634894 +0000 UTC m=+1838.115321385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-maas-api-tls") pod "maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs" (UID: "9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a") : secret "maas-api-e2e-ait-92b395e7-serving-cert" not found
Jul 12 22:22:59.757026 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:22:59.756998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:00.256670 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:23:00.256635    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-serving-cert: secret "maas-api-e2e-ait-92b395e7-serving-cert" not found
Jul 12 22:23:00.256889 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:23:00.256731    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-maas-api-tls podName:9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a nodeName:}" failed. No retries permitted until 2026-07-12 22:23:01.256691495 +0000 UTC m=+1839.120377986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-maas-api-tls") pod "maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs" (UID: "9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a") : secret "maas-api-e2e-ait-92b395e7-serving-cert" not found
Jul 12 22:23:00.657682 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:00.657635    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs" podUID="9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a" containerName="maas-api" containerID="cri-o://8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4" gracePeriod=30
Jul 12 22:23:00.898270 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:00.898240    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:23:01.064108 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.064017    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb6cv\" (UniqueName: \"kubernetes.io/projected/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-kube-api-access-kb6cv\") pod \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") "
Jul 12 22:23:01.064108 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.064070    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-openshift-service-ca\") pod \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") "
Jul 12 22:23:01.064332 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.064127    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-maas-api-tls\") pod \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\" (UID: \"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a\") "
Jul 12 22:23:01.064454 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.064427    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a" (UID: "9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:23:01.066181 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.066149    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a" (UID: "9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:23:01.066283 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.066199    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-kube-api-access-kb6cv" (OuterVolumeSpecName: "kube-api-access-kb6cv") pod "9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a" (UID: "9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a"). InnerVolumeSpecName "kube-api-access-kb6cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:23:01.165473 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.165435    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb6cv\" (UniqueName: \"kubernetes.io/projected/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-kube-api-access-kb6cv\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:23:01.165473 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.165466    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-openshift-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:23:01.165473 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.165476    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a-maas-api-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:23:01.662826 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.662794    2581 generic.go:356] "Generic (PLEG): container finished" podID="9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a" containerID="8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4" exitCode=0
Jul 12 22:23:01.663026 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.662840    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"
Jul 12 22:23:01.663026 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.662837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs" event={"ID":"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a","Type":"ContainerDied","Data":"8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4"}
Jul 12 22:23:01.663026 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.662960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs" event={"ID":"9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a","Type":"ContainerDied","Data":"b5b1d8f683a32a16f74245333e8a720d6260a39330387d1483802526786a71eb"}
Jul 12 22:23:01.663141 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.663036    2581 scope.go:117] "RemoveContainer" containerID="8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4"
Jul 12 22:23:01.671928 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.671911    2581 scope.go:117] "RemoveContainer" containerID="8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4"
Jul 12 22:23:01.672197 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:23:01.672179    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4\": container with ID starting with 8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4 not found: ID does not exist" containerID="8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4"
Jul 12 22:23:01.672264 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.672206    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4"} err="failed to get container status \"8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4\": rpc error: code = NotFound desc = could not find container \"8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4\": container with ID starting with 8b52de8405ac16d67b3e0d50fb0aaa81bdfcceb40b147f525cb24a2e0c490ea4 not found: ID does not exist"
Jul 12 22:23:01.684767 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.684734    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"]
Jul 12 22:23:01.688454 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:01.688430    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92b395e7-765cd6dcdd-th8bs"]
Jul 12 22:23:02.669595 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:02.669563    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a" path="/var/lib/kubelet/pods/9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a/volumes"
Jul 12 22:23:02.939070 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:02.938985    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:23:04.276208 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:04.276177    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:10.157014 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:10.156981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:10.257715 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:10.257673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:15.281689 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:15.281657    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:15.608273 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:15.608236    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:16.717146 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.717100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:16.819819 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.819782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:16.825003 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.824973    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"]
Jul 12 22:23:16.825365 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.825348    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a" containerName="maas-api"
Jul 12 22:23:16.825446 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.825368    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a" containerName="maas-api"
Jul 12 22:23:16.825446 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.825384    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerName="revoke-keys"
Jul 12 22:23:16.825446 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.825392    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerName="revoke-keys"
Jul 12 22:23:16.825446 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.825426    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e10fe9a-a139-47c9-952c-2ae0c1bf2642" containerName="revoke-keys"
Jul 12 22:23:16.825446 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.825435    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e10fe9a-a139-47c9-952c-2ae0c1bf2642" containerName="revoke-keys"
Jul 12 22:23:16.825691 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.825520    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cd9ee6e-3a48-4a0b-94c4-4149b8753e6a" containerName="maas-api"
Jul 12 22:23:16.825691 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.825534    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e10fe9a-a139-47c9-952c-2ae0c1bf2642" containerName="revoke-keys"
Jul 12 22:23:16.825691 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.825544    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8fb6cc9-10a3-4b40-9586-87c89645a65e" containerName="revoke-keys"
Jul 12 22:23:16.828508 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.828488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:16.831482 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.831460    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 22:23:16.831684 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.831648    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f4rcr\""
Jul 12 22:23:16.831956 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.831941    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-6cea543a-serving-cert\""
Jul 12 22:23:16.832810 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.832790    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 22:23:16.840820 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.840798    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"]
Jul 12 22:23:16.887943 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.887905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-maas-api-tls\") pod \"maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:16.888117 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.887976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-openshift-service-ca\") pod \"maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:16.888117 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.888045    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpsw6\" (UniqueName: \"kubernetes.io/projected/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-kube-api-access-dpsw6\") pod \"maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:16.898564 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.898532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:16.988504 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.988422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpsw6\" (UniqueName: \"kubernetes.io/projected/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-kube-api-access-dpsw6\") pod \"maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:16.988504 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.988485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-maas-api-tls\") pod \"maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:16.988753 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.988509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-openshift-service-ca\") pod \"maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:16.989148 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.989123    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-openshift-service-ca\") pod \"maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:16.991084 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.991061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-maas-api-tls\") pod \"maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:16.998903 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.998864    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:16.999414 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:16.999391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpsw6\" (UniqueName: \"kubernetes.io/projected/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-kube-api-access-dpsw6\") pod \"maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:17.141386 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:17.141352    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:17.278554 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:17.278529    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"]
Jul 12 22:23:17.281142 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:23:17.281119    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6a706b_bdf3_406c_b1b6_7769d6fc7442.slice/crio-060669be4ce9699733bfe4cdced86e85181fd7dce00ad100329ddbef937cc0d6 WatchSource:0}: Error finding container 060669be4ce9699733bfe4cdced86e85181fd7dce00ad100329ddbef937cc0d6: Status 404 returned error can't find the container with id 060669be4ce9699733bfe4cdced86e85181fd7dce00ad100329ddbef937cc0d6
Jul 12 22:23:17.458140 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:17.458094    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:17.558623 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:17.558494    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:17.747844 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:17.747807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg" event={"ID":"eb6a706b-bdf3-406c-b1b6-7769d6fc7442","Type":"ContainerStarted","Data":"4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486"}
Jul 12 22:23:17.748281 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:17.747888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg" event={"ID":"eb6a706b-bdf3-406c-b1b6-7769d6fc7442","Type":"ContainerStarted","Data":"060669be4ce9699733bfe4cdced86e85181fd7dce00ad100329ddbef937cc0d6"}
Jul 12 22:23:17.748281 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:17.747934    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:17.768345 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:17.768283    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg" podStartSLOduration=1.423166056 podStartE2EDuration="1.768264727s" totalImagesPullingTime="345.098671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:23:17.766983762 +0000 UTC m=+1855.630670312" watchObservedRunningTime="2026-07-12 22:23:17.768264727 +0000 UTC m=+1855.631951240"
Jul 12 22:23:19.441311 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:19.441274    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:23:21.078875 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.078792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:21.095748 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.095713    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"]
Jul 12 22:23:21.099255 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.099239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"
Jul 12 22:23:21.101815 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.101795    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:23:21.106313 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.106290    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"]
Jul 12 22:23:21.126908 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.126879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75529f3-f15c-42a4-8f6c-cb76c5beb7da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6cea543a-q7r56\" (UID: \"a75529f3-f15c-42a4-8f6c-cb76c5beb7da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"
Jul 12 22:23:21.138004 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.137978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:21.228057 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.228025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75529f3-f15c-42a4-8f6c-cb76c5beb7da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6cea543a-q7r56\" (UID: \"a75529f3-f15c-42a4-8f6c-cb76c5beb7da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"
Jul 12 22:23:21.228652 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.228629    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75529f3-f15c-42a4-8f6c-cb76c5beb7da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6cea543a-q7r56\" (UID: \"a75529f3-f15c-42a4-8f6c-cb76c5beb7da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"
Jul 12 22:23:21.410914 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.410869    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"
Jul 12 22:23:21.541816 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.541782    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"]
Jul 12 22:23:21.545036 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:23:21.545006    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75529f3_f15c_42a4_8f6c_cb76c5beb7da.slice/crio-367367ce8831059793097c467763ef711e8abf50ba8423b3f420ee220e6b2cf8 WatchSource:0}: Error finding container 367367ce8831059793097c467763ef711e8abf50ba8423b3f420ee220e6b2cf8: Status 404 returned error can't find the container with id 367367ce8831059793097c467763ef711e8abf50ba8423b3f420ee220e6b2cf8
Jul 12 22:23:21.767769 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:21.767658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56" event={"ID":"a75529f3-f15c-42a4-8f6c-cb76c5beb7da","Type":"ContainerStarted","Data":"367367ce8831059793097c467763ef711e8abf50ba8423b3f420ee220e6b2cf8"}
Jul 12 22:23:22.774400 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:22.774363    2581 generic.go:356] "Generic (PLEG): container finished" podID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerID="62a65e924903b25272e67dac00228dbcdcade8118c8c9fd45b49325f90267842" exitCode=7
Jul 12 22:23:22.774832 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:22.774433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56" event={"ID":"a75529f3-f15c-42a4-8f6c-cb76c5beb7da","Type":"ContainerDied","Data":"62a65e924903b25272e67dac00228dbcdcade8118c8c9fd45b49325f90267842"}
Jul 12 22:23:22.774832 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:22.774717    2581 scope.go:117] "RemoveContainer" containerID="62a65e924903b25272e67dac00228dbcdcade8118c8c9fd45b49325f90267842"
Jul 12 22:23:23.758053 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:23.757966    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:23:23.781339 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:23.781311    2581 generic.go:356] "Generic (PLEG): container finished" podID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerID="b8dd5fa9fd5be7ac5d8eebf9770c58f63eed84772908a70d1cdd0c7816031031" exitCode=7
Jul 12 22:23:23.781743 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:23.781371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56" event={"ID":"a75529f3-f15c-42a4-8f6c-cb76c5beb7da","Type":"ContainerDied","Data":"b8dd5fa9fd5be7ac5d8eebf9770c58f63eed84772908a70d1cdd0c7816031031"}
Jul 12 22:23:23.781743 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:23.781419    2581 scope.go:117] "RemoveContainer" containerID="62a65e924903b25272e67dac00228dbcdcade8118c8c9fd45b49325f90267842"
Jul 12 22:23:23.781743 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:23.781602    2581 scope.go:117] "RemoveContainer" containerID="b8dd5fa9fd5be7ac5d8eebf9770c58f63eed84772908a70d1cdd0c7816031031"
Jul 12 22:23:23.781891 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:23:23.781866    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-6cea543a-q7r56_odh-ai-gateway-infra(a75529f3-f15c-42a4-8f6c-cb76c5beb7da)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da"
Jul 12 22:23:24.787623 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:24.787589    2581 scope.go:117] "RemoveContainer" containerID="b8dd5fa9fd5be7ac5d8eebf9770c58f63eed84772908a70d1cdd0c7816031031"
Jul 12 22:23:24.788143 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:23:24.787814    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-6cea543a-q7r56_odh-ai-gateway-infra(a75529f3-f15c-42a4-8f6c-cb76c5beb7da)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da"
Jul 12 22:23:26.731405 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:26.731372    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:26.789024 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:26.788990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:30.000006 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:29.999941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:23:37.664505 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:37.664478    2581 scope.go:117] "RemoveContainer" containerID="b8dd5fa9fd5be7ac5d8eebf9770c58f63eed84772908a70d1cdd0c7816031031"
Jul 12 22:23:38.859777 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:38.859747    2581 generic.go:356] "Generic (PLEG): container finished" podID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerID="8652bd643ddafccfc00a0448e24344b194515c0b0e60fd571f98618f2e53a670" exitCode=0
Jul 12 22:23:38.860216 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:38.859824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56" event={"ID":"a75529f3-f15c-42a4-8f6c-cb76c5beb7da","Type":"ContainerDied","Data":"8652bd643ddafccfc00a0448e24344b194515c0b0e60fd571f98618f2e53a670"}
Jul 12 22:23:38.860216 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:38.859886    2581 scope.go:117] "RemoveContainer" containerID="b8dd5fa9fd5be7ac5d8eebf9770c58f63eed84772908a70d1cdd0c7816031031"
Jul 12 22:23:39.886458 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:39.886423    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"]
Jul 12 22:23:39.994987 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:39.994964    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"
Jul 12 22:23:40.097808 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:40.097777    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75529f3-f15c-42a4-8f6c-cb76c5beb7da-maas-api-service-ca\") pod \"a75529f3-f15c-42a4-8f6c-cb76c5beb7da\" (UID: \"a75529f3-f15c-42a4-8f6c-cb76c5beb7da\") "
Jul 12 22:23:40.098160 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:40.098136    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a75529f3-f15c-42a4-8f6c-cb76c5beb7da-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a75529f3-f15c-42a4-8f6c-cb76c5beb7da" (UID: "a75529f3-f15c-42a4-8f6c-cb76c5beb7da"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:23:40.199235 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:40.199144    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a75529f3-f15c-42a4-8f6c-cb76c5beb7da-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:23:40.872828 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:40.872798    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"
Jul 12 22:23:40.873004 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:40.872833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56" event={"ID":"a75529f3-f15c-42a4-8f6c-cb76c5beb7da","Type":"ContainerDied","Data":"367367ce8831059793097c467763ef711e8abf50ba8423b3f420ee220e6b2cf8"}
Jul 12 22:23:40.873004 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:40.872880    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="367367ce8831059793097c467763ef711e8abf50ba8423b3f420ee220e6b2cf8"
Jul 12 22:23:40.903080 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:40.903027    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"]
Jul 12 22:23:40.906801 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:40.906775    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-q7r56"]
Jul 12 22:23:42.669855 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:23:42.669816    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" path="/var/lib/kubelet/pods/a75529f3-f15c-42a4-8f6c-cb76c5beb7da/volumes"
Jul 12 22:24:11.142637 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.142601    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg"]
Jul 12 22:24:11.143122 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.142947    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerName="revoke-keys"
Jul 12 22:24:11.143122 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.142960    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerName="revoke-keys"
Jul 12 22:24:11.143122 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.142975    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerName="revoke-keys"
Jul 12 22:24:11.143122 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.142980    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerName="revoke-keys"
Jul 12 22:24:11.143122 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.142994    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerName="revoke-keys"
Jul 12 22:24:11.143122 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.143000    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerName="revoke-keys"
Jul 12 22:24:11.143122 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.143050    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerName="revoke-keys"
Jul 12 22:24:11.143122 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.143058    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerName="revoke-keys"
Jul 12 22:24:11.146291 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.146275    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg"
Jul 12 22:24:11.148964 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.148941    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:24:11.162939 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.162900    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg"]
Jul 12 22:24:11.178598 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.178564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf402a23-acdb-466b-a066-4e2663a7a0f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg\" (UID: \"bf402a23-acdb-466b-a066-4e2663a7a0f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg"
Jul 12 22:24:11.279681 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.279641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf402a23-acdb-466b-a066-4e2663a7a0f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg\" (UID: \"bf402a23-acdb-466b-a066-4e2663a7a0f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg"
Jul 12 22:24:11.280331 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.280309    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf402a23-acdb-466b-a066-4e2663a7a0f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg\" (UID: \"bf402a23-acdb-466b-a066-4e2663a7a0f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg"
Jul 12 22:24:11.463766 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.463671    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg"
Jul 12 22:24:11.593317 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:11.593236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg"]
Jul 12 22:24:11.595858 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:24:11.595835    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf402a23_acdb_466b_a066_4e2663a7a0f5.slice/crio-7974f1eb41ae9e778d118ab0bdcb39fdc8fca2452c752f02129d988c3614b536 WatchSource:0}: Error finding container 7974f1eb41ae9e778d118ab0bdcb39fdc8fca2452c752f02129d988c3614b536: Status 404 returned error can't find the container with id 7974f1eb41ae9e778d118ab0bdcb39fdc8fca2452c752f02129d988c3614b536
Jul 12 22:24:12.027324 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:12.027286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg" event={"ID":"bf402a23-acdb-466b-a066-4e2663a7a0f5","Type":"ContainerStarted","Data":"44e4bb68dcbc1b12c0be43015d37095691e3a7a57733829431eb3604b27d300b"}
Jul 12 22:24:12.027534 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:12.027340    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg" event={"ID":"bf402a23-acdb-466b-a066-4e2663a7a0f5","Type":"ContainerStarted","Data":"7974f1eb41ae9e778d118ab0bdcb39fdc8fca2452c752f02129d988c3614b536"}
Jul 12 22:24:12.051413 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:12.051309    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg" podStartSLOduration=1.05129265 podStartE2EDuration="1.05129265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:24:12.049117803 +0000 UTC m=+1909.912804315" watchObservedRunningTime="2026-07-12 22:24:12.05129265 +0000 UTC m=+1909.914979163"
Jul 12 22:24:13.033488 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:13.033442    2581 generic.go:356] "Generic (PLEG): container finished" podID="bf402a23-acdb-466b-a066-4e2663a7a0f5" containerID="44e4bb68dcbc1b12c0be43015d37095691e3a7a57733829431eb3604b27d300b" exitCode=0
Jul 12 22:24:13.034092 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:13.033537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg" event={"ID":"bf402a23-acdb-466b-a066-4e2663a7a0f5","Type":"ContainerDied","Data":"44e4bb68dcbc1b12c0be43015d37095691e3a7a57733829431eb3604b27d300b"}
Jul 12 22:24:14.184060 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:14.184036    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg"
Jul 12 22:24:14.309307 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:14.309211    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf402a23-acdb-466b-a066-4e2663a7a0f5-maas-api-service-ca\") pod \"bf402a23-acdb-466b-a066-4e2663a7a0f5\" (UID: \"bf402a23-acdb-466b-a066-4e2663a7a0f5\") "
Jul 12 22:24:14.309581 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:14.309556    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf402a23-acdb-466b-a066-4e2663a7a0f5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf402a23-acdb-466b-a066-4e2663a7a0f5" (UID: "bf402a23-acdb-466b-a066-4e2663a7a0f5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:24:14.410173 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:14.410135    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf402a23-acdb-466b-a066-4e2663a7a0f5-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:24:15.044377 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:15.044301    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg"
Jul 12 22:24:15.044377 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:15.044332    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg" event={"ID":"bf402a23-acdb-466b-a066-4e2663a7a0f5","Type":"ContainerDied","Data":"7974f1eb41ae9e778d118ab0bdcb39fdc8fca2452c752f02129d988c3614b536"}
Jul 12 22:24:15.044560 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:15.044381    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7974f1eb41ae9e778d118ab0bdcb39fdc8fca2452c752f02129d988c3614b536"
Jul 12 22:24:21.500638 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.500591    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"]
Jul 12 22:24:21.501140 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.500902    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg" podUID="eb6a706b-bdf3-406c-b1b6-7769d6fc7442" containerName="maas-api" containerID="cri-o://4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486" gracePeriod=30
Jul 12 22:24:21.523915 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.523887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:21.748583 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.748555    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:24:21.874954 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.874922    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-maas-api-tls\") pod \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") "
Jul 12 22:24:21.875158 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.875042    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-openshift-service-ca\") pod \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") "
Jul 12 22:24:21.875158 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.875084    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpsw6\" (UniqueName: \"kubernetes.io/projected/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-kube-api-access-dpsw6\") pod \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\" (UID: \"eb6a706b-bdf3-406c-b1b6-7769d6fc7442\") "
Jul 12 22:24:21.875439 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.875413    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eb6a706b-bdf3-406c-b1b6-7769d6fc7442" (UID: "eb6a706b-bdf3-406c-b1b6-7769d6fc7442"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:24:21.877073 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.877039    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-kube-api-access-dpsw6" (OuterVolumeSpecName: "kube-api-access-dpsw6") pod "eb6a706b-bdf3-406c-b1b6-7769d6fc7442" (UID: "eb6a706b-bdf3-406c-b1b6-7769d6fc7442"). InnerVolumeSpecName "kube-api-access-dpsw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:24:21.877158 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.877078    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eb6a706b-bdf3-406c-b1b6-7769d6fc7442" (UID: "eb6a706b-bdf3-406c-b1b6-7769d6fc7442"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:24:21.976034 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.975994    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-maas-api-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:24:21.976034 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.976024    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-openshift-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:24:21.976034 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:21.976036    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpsw6\" (UniqueName: \"kubernetes.io/projected/eb6a706b-bdf3-406c-b1b6-7769d6fc7442-kube-api-access-dpsw6\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:24:22.080715 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:22.080669    2581 generic.go:356] "Generic (PLEG): container finished" podID="eb6a706b-bdf3-406c-b1b6-7769d6fc7442" containerID="4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486" exitCode=0
Jul 12 22:24:22.080891 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:22.080723    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"
Jul 12 22:24:22.080891 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:22.080763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg" event={"ID":"eb6a706b-bdf3-406c-b1b6-7769d6fc7442","Type":"ContainerDied","Data":"4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486"}
Jul 12 22:24:22.080891 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:22.080823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg" event={"ID":"eb6a706b-bdf3-406c-b1b6-7769d6fc7442","Type":"ContainerDied","Data":"060669be4ce9699733bfe4cdced86e85181fd7dce00ad100329ddbef937cc0d6"}
Jul 12 22:24:22.080891 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:22.080848    2581 scope.go:117] "RemoveContainer" containerID="4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486"
Jul 12 22:24:22.090023 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:22.090006    2581 scope.go:117] "RemoveContainer" containerID="4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486"
Jul 12 22:24:22.090265 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:24:22.090250    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486\": container with ID starting with 4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486 not found: ID does not exist" containerID="4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486"
Jul 12 22:24:22.090305 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:22.090274    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486"} err="failed to get container status \"4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486\": rpc error: code = NotFound desc = could not find container \"4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486\": container with ID starting with 4a9355b329987443a76994c55662504069c9bbfe6e91329e8aadd6564a358486 not found: ID does not exist"
Jul 12 22:24:22.104818 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:22.104792    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"]
Jul 12 22:24:22.109288 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:22.109264    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6cea543a-57d4fd588c-txwvg"]
Jul 12 22:24:22.668961 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:22.668921    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb6a706b-bdf3-406c-b1b6-7769d6fc7442" path="/var/lib/kubelet/pods/eb6a706b-bdf3-406c-b1b6-7769d6fc7442/volumes"
Jul 12 22:24:24.446411 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:24.446379    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:24:26.218908 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:26.218872    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:32.013377 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:32.013310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:32.093831 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:32.093791    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:36.422300 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:36.422266    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:37.004287 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:37.004245    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:37.092787 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:37.092691    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:37.191561 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:37.191527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:38.645319 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:38.645286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:42.657279 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:42.657235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:44.687114 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:44.687080    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:44.830338 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:44.830309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:44.936623 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:44.936585    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:45.026559 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:45.026467    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:24:45.398368 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:24:45.398333    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:11.368817 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:11.368783    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:17.413683 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:17.413554    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:17.515310 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:17.515248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:17.610547 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:17.610506    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:33.556191 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:33.556155    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:39.365879 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:39.365843    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:39.472228 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:39.472181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:39.565710 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:39.565675    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:50.066186 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:50.066150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:50.859839 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:50.859806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:56.753283 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:56.753249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:56.817313 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:56.817280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:56.897209 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:56.897176    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:56.996541 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:56.996508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:57.096818 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:57.096790    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:57.789428 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:57.789393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:57.889407 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:57.889376    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:57.988313 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:57.988279    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:25:59.591148 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:25:59.591113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:01.346959 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:01.346927    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:26:05.582064 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:05.582034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:05.680003 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:05.679968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:06.239009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:06.238977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:11.042786 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:11.042752    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:26:12.186062 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:12.186032    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:12.285651 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:12.285612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:12.423379 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:12.423341    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:12.727449 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:12.727418    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:13.018901 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:13.018820    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:15.591508 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.591475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:15.665816 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.665754    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"]
Jul 12 22:26:15.666249 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.666235    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb6a706b-bdf3-406c-b1b6-7769d6fc7442" containerName="maas-api"
Jul 12 22:26:15.666307 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.666254    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb6a706b-bdf3-406c-b1b6-7769d6fc7442" containerName="maas-api"
Jul 12 22:26:15.666307 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.666272    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf402a23-acdb-466b-a066-4e2663a7a0f5" containerName="revoke-keys"
Jul 12 22:26:15.666307 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.666281    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf402a23-acdb-466b-a066-4e2663a7a0f5" containerName="revoke-keys"
Jul 12 22:26:15.666403 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.666372    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75529f3-f15c-42a4-8f6c-cb76c5beb7da" containerName="revoke-keys"
Jul 12 22:26:15.666403 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.666388    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb6a706b-bdf3-406c-b1b6-7769d6fc7442" containerName="maas-api"
Jul 12 22:26:15.666403 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.666397    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf402a23-acdb-466b-a066-4e2663a7a0f5" containerName="revoke-keys"
Jul 12 22:26:15.669957 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.669931    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:15.674352 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.674331    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 22:26:15.674455 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.674431    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 22:26:15.674867 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.674848    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3283879f-serving-cert\""
Jul 12 22:26:15.674968 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.674852    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f4rcr\""
Jul 12 22:26:15.683296 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.683275    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"]
Jul 12 22:26:15.688923 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.688903    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:15.696143 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.696120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5048bbac-57a8-4827-9766-08b51c60a4c6-openshift-service-ca\") pod \"maas-api-e2e-mt-3283879f-6997c667b7-5kch4\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:15.696233 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.696152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c22z7\" (UniqueName: \"kubernetes.io/projected/5048bbac-57a8-4827-9766-08b51c60a4c6-kube-api-access-c22z7\") pod \"maas-api-e2e-mt-3283879f-6997c667b7-5kch4\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:15.696233 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.696212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5048bbac-57a8-4827-9766-08b51c60a4c6-maas-api-tls\") pod \"maas-api-e2e-mt-3283879f-6997c667b7-5kch4\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:15.762637 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.762608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:15.796950 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.796914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5048bbac-57a8-4827-9766-08b51c60a4c6-maas-api-tls\") pod \"maas-api-e2e-mt-3283879f-6997c667b7-5kch4\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:15.797135 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.797006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5048bbac-57a8-4827-9766-08b51c60a4c6-openshift-service-ca\") pod \"maas-api-e2e-mt-3283879f-6997c667b7-5kch4\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:15.797135 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.797034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c22z7\" (UniqueName: \"kubernetes.io/projected/5048bbac-57a8-4827-9766-08b51c60a4c6-kube-api-access-c22z7\") pod \"maas-api-e2e-mt-3283879f-6997c667b7-5kch4\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:15.797135 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:26:15.797067    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-serving-cert: secret "maas-api-e2e-mt-3283879f-serving-cert" not found
Jul 12 22:26:15.797307 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:26:15.797157    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5048bbac-57a8-4827-9766-08b51c60a4c6-maas-api-tls podName:5048bbac-57a8-4827-9766-08b51c60a4c6 nodeName:}" failed. No retries permitted until 2026-07-12 22:26:16.297134587 +0000 UTC m=+2034.160821097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5048bbac-57a8-4827-9766-08b51c60a4c6-maas-api-tls") pod "maas-api-e2e-mt-3283879f-6997c667b7-5kch4" (UID: "5048bbac-57a8-4827-9766-08b51c60a4c6") : secret "maas-api-e2e-mt-3283879f-serving-cert" not found
Jul 12 22:26:15.797634 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.797614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5048bbac-57a8-4827-9766-08b51c60a4c6-openshift-service-ca\") pod \"maas-api-e2e-mt-3283879f-6997c667b7-5kch4\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:15.806404 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.806380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c22z7\" (UniqueName: \"kubernetes.io/projected/5048bbac-57a8-4827-9766-08b51c60a4c6-kube-api-access-c22z7\") pod \"maas-api-e2e-mt-3283879f-6997c667b7-5kch4\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:15.947561 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:15.947461    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:16.270451 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:16.270360    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:16.301026 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:16.300989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5048bbac-57a8-4827-9766-08b51c60a4c6-maas-api-tls\") pod \"maas-api-e2e-mt-3283879f-6997c667b7-5kch4\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:16.303473 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:16.303451    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5048bbac-57a8-4827-9766-08b51c60a4c6-maas-api-tls\") pod \"maas-api-e2e-mt-3283879f-6997c667b7-5kch4\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:16.393439 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:16.393397    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:16.580570 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:16.580484    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:16.716014 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:16.715918    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"]
Jul 12 22:26:16.718183 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:26:16.718156    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5048bbac_57a8_4827_9766_08b51c60a4c6.slice/crio-48dc0e0d87b53934c544c04d9f4590602dd2301bea4d090f24dcd033e04b41a1 WatchSource:0}: Error finding container 48dc0e0d87b53934c544c04d9f4590602dd2301bea4d090f24dcd033e04b41a1: Status 404 returned error can't find the container with id 48dc0e0d87b53934c544c04d9f4590602dd2301bea4d090f24dcd033e04b41a1
Jul 12 22:26:16.719423 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:16.719406    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 22:26:17.633999 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:17.633956    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4" event={"ID":"5048bbac-57a8-4827-9766-08b51c60a4c6","Type":"ContainerStarted","Data":"7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703"}
Jul 12 22:26:17.634191 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:17.634014    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4" event={"ID":"5048bbac-57a8-4827-9766-08b51c60a4c6","Type":"ContainerStarted","Data":"48dc0e0d87b53934c544c04d9f4590602dd2301bea4d090f24dcd033e04b41a1"}
Jul 12 22:26:17.634191 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:17.634065    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:17.654089 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:17.654035    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4" podStartSLOduration=2.204185798 podStartE2EDuration="2.654019595s" totalImagesPullingTime="449.833797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:26:17.652164947 +0000 UTC m=+2035.515851461" watchObservedRunningTime="2026-07-12 22:26:17.654019595 +0000 UTC m=+2035.517706086"
Jul 12 22:26:20.063515 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:20.063477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:20.782028 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:20.781989    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:20.926769 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:20.926737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:21.166238 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:21.166199    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:22.722915 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:22.722881    2581 scope.go:117] "RemoveContainer" containerID="7b830c10a738ce2f1cbc2e74dad9daf53af23f8ddefee0c1648d1355eadfdf61"
Jul 12 22:26:22.942128 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:22.942041    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:26:23.644242 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:23.644204    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:26.983824 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:26.983794    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:27.083682 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:27.083652    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:27.334772 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:27.334739    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz"]
Jul 12 22:26:27.338128 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:27.338105    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz"
Jul 12 22:26:27.340673 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:27.340652    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:26:27.349862 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:27.349834    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz"]
Jul 12 22:26:27.396945 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:27.396908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f960f3cf-bb38-4111-a680-5a9f0711d850-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3283879f-hg2qz\" (UID: \"f960f3cf-bb38-4111-a680-5a9f0711d850\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz"
Jul 12 22:26:27.498103 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:27.498063    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f960f3cf-bb38-4111-a680-5a9f0711d850-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3283879f-hg2qz\" (UID: \"f960f3cf-bb38-4111-a680-5a9f0711d850\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz"
Jul 12 22:26:27.498751 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:27.498732    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f960f3cf-bb38-4111-a680-5a9f0711d850-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3283879f-hg2qz\" (UID: \"f960f3cf-bb38-4111-a680-5a9f0711d850\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz"
Jul 12 22:26:27.648051 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:27.647948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz"
Jul 12 22:26:27.780971 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:27.780944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz"]
Jul 12 22:26:27.783212 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:26:27.783184    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf960f3cf_bb38_4111_a680_5a9f0711d850.slice/crio-248075c7e462daf9a7643d7fad25f75151c5f79ee181bfd8a67dcb31f520b186 WatchSource:0}: Error finding container 248075c7e462daf9a7643d7fad25f75151c5f79ee181bfd8a67dcb31f520b186: Status 404 returned error can't find the container with id 248075c7e462daf9a7643d7fad25f75151c5f79ee181bfd8a67dcb31f520b186
Jul 12 22:26:28.687140 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:28.687109    2581 generic.go:356] "Generic (PLEG): container finished" podID="f960f3cf-bb38-4111-a680-5a9f0711d850" containerID="13afe764ed7826e62ee57a7b616d151d38742c7b7394d01befd86280e248ab14" exitCode=0
Jul 12 22:26:28.687140 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:28.687144    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz" event={"ID":"f960f3cf-bb38-4111-a680-5a9f0711d850","Type":"ContainerDied","Data":"13afe764ed7826e62ee57a7b616d151d38742c7b7394d01befd86280e248ab14"}
Jul 12 22:26:28.687547 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:28.687182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz" event={"ID":"f960f3cf-bb38-4111-a680-5a9f0711d850","Type":"ContainerStarted","Data":"248075c7e462daf9a7643d7fad25f75151c5f79ee181bfd8a67dcb31f520b186"}
Jul 12 22:26:29.820375 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:29.820352    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz"
Jul 12 22:26:29.918202 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:29.918160    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f960f3cf-bb38-4111-a680-5a9f0711d850-maas-api-service-ca\") pod \"f960f3cf-bb38-4111-a680-5a9f0711d850\" (UID: \"f960f3cf-bb38-4111-a680-5a9f0711d850\") "
Jul 12 22:26:29.918537 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:29.918516    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f960f3cf-bb38-4111-a680-5a9f0711d850-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f960f3cf-bb38-4111-a680-5a9f0711d850" (UID: "f960f3cf-bb38-4111-a680-5a9f0711d850"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:26:30.018847 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:30.018755    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f960f3cf-bb38-4111-a680-5a9f0711d850-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:26:30.697529 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:30.697499    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz"
Jul 12 22:26:30.697683 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:30.697499    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3283879f-hg2qz" event={"ID":"f960f3cf-bb38-4111-a680-5a9f0711d850","Type":"ContainerDied","Data":"248075c7e462daf9a7643d7fad25f75151c5f79ee181bfd8a67dcb31f520b186"}
Jul 12 22:26:30.697683 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:30.697620    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="248075c7e462daf9a7643d7fad25f75151c5f79ee181bfd8a67dcb31f520b186"
Jul 12 22:26:37.725237 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:37.725185    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"]
Jul 12 22:26:37.725837 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:37.725461    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4" podUID="5048bbac-57a8-4827-9766-08b51c60a4c6" containerName="maas-api" containerID="cri-o://7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703" gracePeriod=30
Jul 12 22:26:37.754731 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:37.754688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:37.981577 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:37.981517    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:38.091445 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.091405    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5048bbac-57a8-4827-9766-08b51c60a4c6-maas-api-tls\") pod \"5048bbac-57a8-4827-9766-08b51c60a4c6\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") "
Jul 12 22:26:38.091629 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.091496    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5048bbac-57a8-4827-9766-08b51c60a4c6-openshift-service-ca\") pod \"5048bbac-57a8-4827-9766-08b51c60a4c6\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") "
Jul 12 22:26:38.091680 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.091658    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c22z7\" (UniqueName: \"kubernetes.io/projected/5048bbac-57a8-4827-9766-08b51c60a4c6-kube-api-access-c22z7\") pod \"5048bbac-57a8-4827-9766-08b51c60a4c6\" (UID: \"5048bbac-57a8-4827-9766-08b51c60a4c6\") "
Jul 12 22:26:38.091902 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.091868    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5048bbac-57a8-4827-9766-08b51c60a4c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5048bbac-57a8-4827-9766-08b51c60a4c6" (UID: "5048bbac-57a8-4827-9766-08b51c60a4c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:26:38.092018 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.091989    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5048bbac-57a8-4827-9766-08b51c60a4c6-openshift-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:26:38.093649 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.093626    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5048bbac-57a8-4827-9766-08b51c60a4c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5048bbac-57a8-4827-9766-08b51c60a4c6" (UID: "5048bbac-57a8-4827-9766-08b51c60a4c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:26:38.093727 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.093626    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5048bbac-57a8-4827-9766-08b51c60a4c6-kube-api-access-c22z7" (OuterVolumeSpecName: "kube-api-access-c22z7") pod "5048bbac-57a8-4827-9766-08b51c60a4c6" (UID: "5048bbac-57a8-4827-9766-08b51c60a4c6"). InnerVolumeSpecName "kube-api-access-c22z7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:26:38.192578 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.192539    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c22z7\" (UniqueName: \"kubernetes.io/projected/5048bbac-57a8-4827-9766-08b51c60a4c6-kube-api-access-c22z7\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:26:38.192578 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.192572    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5048bbac-57a8-4827-9766-08b51c60a4c6-maas-api-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:26:38.736716 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.736670    2581 generic.go:356] "Generic (PLEG): container finished" podID="5048bbac-57a8-4827-9766-08b51c60a4c6" containerID="7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703" exitCode=0
Jul 12 22:26:38.737106 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.736753    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4" event={"ID":"5048bbac-57a8-4827-9766-08b51c60a4c6","Type":"ContainerDied","Data":"7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703"}
Jul 12 22:26:38.737106 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.736820    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4" event={"ID":"5048bbac-57a8-4827-9766-08b51c60a4c6","Type":"ContainerDied","Data":"48dc0e0d87b53934c544c04d9f4590602dd2301bea4d090f24dcd033e04b41a1"}
Jul 12 22:26:38.737106 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.736844    2581 scope.go:117] "RemoveContainer" containerID="7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703"
Jul 12 22:26:38.737106 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.736771    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"
Jul 12 22:26:38.745360 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.745342    2581 scope.go:117] "RemoveContainer" containerID="7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703"
Jul 12 22:26:38.745619 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:26:38.745600    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703\": container with ID starting with 7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703 not found: ID does not exist" containerID="7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703"
Jul 12 22:26:38.745736 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.745627    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703"} err="failed to get container status \"7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703\": rpc error: code = NotFound desc = could not find container \"7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703\": container with ID starting with 7b90e1fda33da8b3798f3196be8a14c9c7e0ae7d0ec802e8f84078c4f38d7703 not found: ID does not exist"
Jul 12 22:26:38.752981 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.752958    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"]
Jul 12 22:26:38.756415 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:38.756395    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3283879f-6997c667b7-5kch4"]
Jul 12 22:26:40.436306 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:40.436270    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:26:40.668530 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:40.668493    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5048bbac-57a8-4827-9766-08b51c60a4c6" path="/var/lib/kubelet/pods/5048bbac-57a8-4827-9766-08b51c60a4c6/volumes"
Jul 12 22:26:42.415899 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:42.415864    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:48.144389 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:48.144305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:48.244479 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:48.244445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:53.091128 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:53.091084    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:53.332881 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:53.332840    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:53.471778 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:53.471660    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:53.578043 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:53.578009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:53.684064 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:53.684027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:59.513771 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:59.513740    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:59.618677 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:59.618645    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:59.722688 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:59.722655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:26:59.917217 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:26:59.917186    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:05.783685 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:05.783637    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:05.885906 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:05.885870    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:11.272215 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:11.272178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:11.386455 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:11.386425    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:12.598904 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:12.598867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:13.027539 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:13.027429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:13.240018 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:13.239979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:15.961268 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:15.961228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:16.017825 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.017789    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"]
Jul 12 22:27:16.018325 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.018307    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5048bbac-57a8-4827-9766-08b51c60a4c6" containerName="maas-api"
Jul 12 22:27:16.018370 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.018329    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5048bbac-57a8-4827-9766-08b51c60a4c6" containerName="maas-api"
Jul 12 22:27:16.018370 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.018341    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f960f3cf-bb38-4111-a680-5a9f0711d850" containerName="revoke-keys"
Jul 12 22:27:16.018370 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.018346    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f960f3cf-bb38-4111-a680-5a9f0711d850" containerName="revoke-keys"
Jul 12 22:27:16.018467 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.018427    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5048bbac-57a8-4827-9766-08b51c60a4c6" containerName="maas-api"
Jul 12 22:27:16.018467 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.018439    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f960f3cf-bb38-4111-a680-5a9f0711d850" containerName="revoke-keys"
Jul 12 22:27:16.021614 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.021597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:16.024481 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.024460    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 22:27:16.024647 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.024621    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 22:27:16.024786 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.024566    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d3e48a9a-serving-cert\""
Jul 12 22:27:16.025743 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.025722    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f4rcr\""
Jul 12 22:27:16.034513 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.034488    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"]
Jul 12 22:27:16.046237 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.046195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:16.115021 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.114989    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:16.127185 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.127159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md95f\" (UniqueName: \"kubernetes.io/projected/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-kube-api-access-md95f\") pod \"maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:16.127335 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.127199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-maas-api-tls\") pod \"maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:16.127335 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.127269    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-openshift-service-ca\") pod \"maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:16.228383 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.228297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-maas-api-tls\") pod \"maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:16.228383 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.228362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-openshift-service-ca\") pod \"maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:16.228634 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.228404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md95f\" (UniqueName: \"kubernetes.io/projected/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-kube-api-access-md95f\") pod \"maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:16.228634 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:27:16.228473    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-serving-cert: secret "maas-api-e2e-mt-d3e48a9a-serving-cert" not found
Jul 12 22:27:16.228634 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:27:16.228569    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-maas-api-tls podName:f58cbc2e-5799-4aa4-9e01-4be264a21f4b nodeName:}" failed. No retries permitted until 2026-07-12 22:27:16.728545639 +0000 UTC m=+2094.592232142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-maas-api-tls") pod "maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr" (UID: "f58cbc2e-5799-4aa4-9e01-4be264a21f4b") : secret "maas-api-e2e-mt-d3e48a9a-serving-cert" not found
Jul 12 22:27:16.229020 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.229001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-openshift-service-ca\") pod \"maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:16.238477 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.238456    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md95f\" (UniqueName: \"kubernetes.io/projected/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-kube-api-access-md95f\") pod \"maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:16.517983 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.517891    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:16.617434 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.617400    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:16.733005 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.732968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-maas-api-tls\") pod \"maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:16.735449 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.735428    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-maas-api-tls\") pod \"maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:16.931966 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:16.931925    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:17.077665 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:17.077641    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"]
Jul 12 22:27:17.080226 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:27:17.080197    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58cbc2e_5799_4aa4_9e01_4be264a21f4b.slice/crio-154e12e4b490e0db91920394e952d30ab010587eb46a883851c1d1dafb391c21 WatchSource:0}: Error finding container 154e12e4b490e0db91920394e952d30ab010587eb46a883851c1d1dafb391c21: Status 404 returned error can't find the container with id 154e12e4b490e0db91920394e952d30ab010587eb46a883851c1d1dafb391c21
Jul 12 22:27:17.921405 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:17.921370    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr" event={"ID":"f58cbc2e-5799-4aa4-9e01-4be264a21f4b","Type":"ContainerStarted","Data":"e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286"}
Jul 12 22:27:17.921623 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:17.921425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr" event={"ID":"f58cbc2e-5799-4aa4-9e01-4be264a21f4b","Type":"ContainerStarted","Data":"154e12e4b490e0db91920394e952d30ab010587eb46a883851c1d1dafb391c21"}
Jul 12 22:27:17.921623 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:17.921520    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:17.942151 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:17.942100    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr" podStartSLOduration=2.544562892 podStartE2EDuration="2.942085334s" totalImagesPullingTime="397.522442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:27:17.941163125 +0000 UTC m=+2095.804849662" watchObservedRunningTime="2026-07-12 22:27:17.942085334 +0000 UTC m=+2095.805771846"
Jul 12 22:27:20.441763 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:20.441721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:20.550471 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:20.550431    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:27:22.693203 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:22.693170    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:27:22.696468 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:22.696451    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:27:22.742046 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:22.742016    2581 scope.go:117] "RemoveContainer" containerID="f4736c207bace3c9042816bd2ed7c5f5fc2b48832e4de9e6c0a81091e27deceb"
Jul 12 22:27:23.931677 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:23.931643    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:27:31.814336 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:31.814297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:27:36.347013 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:36.346976    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:27:53.273125 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:53.273090    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:27:58.657217 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:58.657178    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw"]
Jul 12 22:27:58.660819 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:58.660791    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw"
Jul 12 22:27:58.663354 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:58.663325    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:27:58.670335 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:58.670309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw"]
Jul 12 22:27:58.704175 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:58.704136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db388e8-0214-4118-ad73-7d154bb2009f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw\" (UID: \"9db388e8-0214-4118-ad73-7d154bb2009f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw"
Jul 12 22:27:58.804891 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:58.804852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db388e8-0214-4118-ad73-7d154bb2009f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw\" (UID: \"9db388e8-0214-4118-ad73-7d154bb2009f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw"
Jul 12 22:27:58.805498 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:58.805473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db388e8-0214-4118-ad73-7d154bb2009f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw\" (UID: \"9db388e8-0214-4118-ad73-7d154bb2009f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw"
Jul 12 22:27:58.972651 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:58.972549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw"
Jul 12 22:27:59.106507 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:59.106462    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw"]
Jul 12 22:27:59.109645 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:27:59.109622    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db388e8_0214_4118_ad73_7d154bb2009f.slice/crio-40c24fb1e4015aa7e8a1130a50918437b57c0a32c7187fe6dcb8171a5f2b8bca WatchSource:0}: Error finding container 40c24fb1e4015aa7e8a1130a50918437b57c0a32c7187fe6dcb8171a5f2b8bca: Status 404 returned error can't find the container with id 40c24fb1e4015aa7e8a1130a50918437b57c0a32c7187fe6dcb8171a5f2b8bca
Jul 12 22:27:59.121412 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:27:59.121386    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw" event={"ID":"9db388e8-0214-4118-ad73-7d154bb2009f","Type":"ContainerStarted","Data":"40c24fb1e4015aa7e8a1130a50918437b57c0a32c7187fe6dcb8171a5f2b8bca"}
Jul 12 22:28:00.127330 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:00.127297    2581 generic.go:356] "Generic (PLEG): container finished" podID="9db388e8-0214-4118-ad73-7d154bb2009f" containerID="28a111c373ad3f237ba2f47989381e92f5f8e90211d1b7a98cfcdee12e7c5e26" exitCode=0
Jul 12 22:28:00.127762 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:00.127384    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw" event={"ID":"9db388e8-0214-4118-ad73-7d154bb2009f","Type":"ContainerDied","Data":"28a111c373ad3f237ba2f47989381e92f5f8e90211d1b7a98cfcdee12e7c5e26"}
Jul 12 22:28:01.260180 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:01.260152    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw"
Jul 12 22:28:01.329416 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:01.329385    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db388e8-0214-4118-ad73-7d154bb2009f-maas-api-service-ca\") pod \"9db388e8-0214-4118-ad73-7d154bb2009f\" (UID: \"9db388e8-0214-4118-ad73-7d154bb2009f\") "
Jul 12 22:28:01.329794 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:01.329773    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9db388e8-0214-4118-ad73-7d154bb2009f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9db388e8-0214-4118-ad73-7d154bb2009f" (UID: "9db388e8-0214-4118-ad73-7d154bb2009f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:28:01.430731 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:01.430620    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db388e8-0214-4118-ad73-7d154bb2009f-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:28:02.139834 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:02.139794    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw" event={"ID":"9db388e8-0214-4118-ad73-7d154bb2009f","Type":"ContainerDied","Data":"40c24fb1e4015aa7e8a1130a50918437b57c0a32c7187fe6dcb8171a5f2b8bca"}
Jul 12 22:28:02.140003 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:02.139854    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40c24fb1e4015aa7e8a1130a50918437b57c0a32c7187fe6dcb8171a5f2b8bca"
Jul 12 22:28:02.140003 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:02.139817    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw"
Jul 12 22:28:09.124092 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.124059    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"]
Jul 12 22:28:09.124571 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.124305    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr" podUID="f58cbc2e-5799-4aa4-9e01-4be264a21f4b" containerName="maas-api" containerID="cri-o://e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286" gracePeriod=30
Jul 12 22:28:09.157842 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.157806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:09.372868 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.372842    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:28:09.497121 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.497028    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-maas-api-tls\") pod \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") "
Jul 12 22:28:09.497121 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.497067    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-openshift-service-ca\") pod \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") "
Jul 12 22:28:09.497121 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.497114    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md95f\" (UniqueName: \"kubernetes.io/projected/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-kube-api-access-md95f\") pod \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\" (UID: \"f58cbc2e-5799-4aa4-9e01-4be264a21f4b\") "
Jul 12 22:28:09.497556 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.497524    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f58cbc2e-5799-4aa4-9e01-4be264a21f4b" (UID: "f58cbc2e-5799-4aa4-9e01-4be264a21f4b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:28:09.499097 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.499073    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f58cbc2e-5799-4aa4-9e01-4be264a21f4b" (UID: "f58cbc2e-5799-4aa4-9e01-4be264a21f4b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:28:09.499221 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.499206    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-kube-api-access-md95f" (OuterVolumeSpecName: "kube-api-access-md95f") pod "f58cbc2e-5799-4aa4-9e01-4be264a21f4b" (UID: "f58cbc2e-5799-4aa4-9e01-4be264a21f4b"). InnerVolumeSpecName "kube-api-access-md95f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:28:09.597981 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.597946    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-maas-api-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:28:09.597981 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.597973    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-openshift-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:28:09.597981 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:09.597985    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md95f\" (UniqueName: \"kubernetes.io/projected/f58cbc2e-5799-4aa4-9e01-4be264a21f4b-kube-api-access-md95f\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:28:10.178657 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:10.178620    2581 generic.go:356] "Generic (PLEG): container finished" podID="f58cbc2e-5799-4aa4-9e01-4be264a21f4b" containerID="e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286" exitCode=0
Jul 12 22:28:10.179106 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:10.178662    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"
Jul 12 22:28:10.179106 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:10.178722    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr" event={"ID":"f58cbc2e-5799-4aa4-9e01-4be264a21f4b","Type":"ContainerDied","Data":"e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286"}
Jul 12 22:28:10.179106 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:10.178775    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr" event={"ID":"f58cbc2e-5799-4aa4-9e01-4be264a21f4b","Type":"ContainerDied","Data":"154e12e4b490e0db91920394e952d30ab010587eb46a883851c1d1dafb391c21"}
Jul 12 22:28:10.179106 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:10.178798    2581 scope.go:117] "RemoveContainer" containerID="e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286"
Jul 12 22:28:10.187588 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:10.187571    2581 scope.go:117] "RemoveContainer" containerID="e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286"
Jul 12 22:28:10.187866 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:28:10.187846    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286\": container with ID starting with e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286 not found: ID does not exist" containerID="e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286"
Jul 12 22:28:10.187930 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:10.187874    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286"} err="failed to get container status \"e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286\": rpc error: code = NotFound desc = could not find container \"e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286\": container with ID starting with e42fb2b46e24039c4026d8afddbd362394598d7b22279225f6acc0eba3e85286 not found: ID does not exist"
Jul 12 22:28:10.201372 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:10.201348    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"]
Jul 12 22:28:10.204343 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:10.204316    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d3e48a9a-5dd7c9f748-nnlqr"]
Jul 12 22:28:10.668724 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:10.668673    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f58cbc2e-5799-4aa4-9e01-4be264a21f4b" path="/var/lib/kubelet/pods/f58cbc2e-5799-4aa4-9e01-4be264a21f4b/volumes"
Jul 12 22:28:13.039406 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:13.039369    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:28:13.739522 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:13.739490    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:18.814503 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:18.814463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:22.764368 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:22.764326    2581 scope.go:117] "RemoveContainer" containerID="9796b70556fb7eb85978f8e1009e9401224a4ba3ce83e8b9edd6c6d9b288bc28"
Jul 12 22:28:32.353287 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:32.353248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:32.408658 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:32.408620    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:41.676204 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:41.676165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:42.013084 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:42.013003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:47.721878 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:47.721843    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:47.790228 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:47.790190    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:55.920977 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:55.920945    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:56.135570 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:56.135535    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:57.162242 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:57.162210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:57.261212 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:57.261177    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:57.417904 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:57.417818    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:58.069579 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:58.069534    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:58.165107 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:58.165072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:58.267002 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:58.266969    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:28:59.575244 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:28:59.575209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:00.151040 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:00.151006    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:29:05.393804 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:05.393769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:05.493718 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:05.493663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:06.057601 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:06.057567    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:11.751121 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:11.751081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:11.856778 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:11.856749    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:11.955138 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:11.955102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:13.932269 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:13.932233    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:29:22.441752 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:22.441715    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:22.779038 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:22.778950    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:43.764289 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:43.764253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:49.614730 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:49.614636    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:49.728188 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:49.728158    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:49.976827 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:49.976745    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:50.293548 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:50.293464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:50.394382 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:50.394348    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:52.808456 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.808421    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:52.899262 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.899231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:52.900378 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.900356    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"]
Jul 12 22:29:52.900744 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.900725    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9db388e8-0214-4118-ad73-7d154bb2009f" containerName="revoke-keys"
Jul 12 22:29:52.900744 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.900742    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9db388e8-0214-4118-ad73-7d154bb2009f" containerName="revoke-keys"
Jul 12 22:29:52.900882 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.900766    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58cbc2e-5799-4aa4-9e01-4be264a21f4b" containerName="maas-api"
Jul 12 22:29:52.900882 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.900777    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58cbc2e-5799-4aa4-9e01-4be264a21f4b" containerName="maas-api"
Jul 12 22:29:52.900882 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.900849    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58cbc2e-5799-4aa4-9e01-4be264a21f4b" containerName="maas-api"
Jul 12 22:29:52.900882 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.900857    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9db388e8-0214-4118-ad73-7d154bb2009f" containerName="revoke-keys"
Jul 12 22:29:52.904054 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.904038    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:52.906819 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.906802    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-65f13b-serving-cert\""
Jul 12 22:29:52.906923 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.906866    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f4rcr\""
Jul 12 22:29:52.908131 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.908114    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 22:29:52.908224 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.908160    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 22:29:52.916847 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.916818    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"]
Jul 12 22:29:52.970134 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:52.970099    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:53.047777 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.047725    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd6e5958-5ad7-4226-ba53-73a924cf1877-maas-api-tls\") pod \"maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:53.047777 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.047780    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd6e5958-5ad7-4226-ba53-73a924cf1877-openshift-service-ca\") pod \"maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:53.048008 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.047800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dwv4\" (UniqueName: \"kubernetes.io/projected/bd6e5958-5ad7-4226-ba53-73a924cf1877-kube-api-access-2dwv4\") pod \"maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:53.149191 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.149155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd6e5958-5ad7-4226-ba53-73a924cf1877-maas-api-tls\") pod \"maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:53.149191 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.149190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd6e5958-5ad7-4226-ba53-73a924cf1877-openshift-service-ca\") pod \"maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:53.149414 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.149211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dwv4\" (UniqueName: \"kubernetes.io/projected/bd6e5958-5ad7-4226-ba53-73a924cf1877-kube-api-access-2dwv4\") pod \"maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:53.149414 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:29:53.149293    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-serving-cert: secret "maas-api-e2e-inf-a-65f13b-serving-cert" not found
Jul 12 22:29:53.149414 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:29:53.149362    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd6e5958-5ad7-4226-ba53-73a924cf1877-maas-api-tls podName:bd6e5958-5ad7-4226-ba53-73a924cf1877 nodeName:}" failed. No retries permitted until 2026-07-12 22:29:53.649346257 +0000 UTC m=+2251.513032748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd6e5958-5ad7-4226-ba53-73a924cf1877-maas-api-tls") pod "maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6" (UID: "bd6e5958-5ad7-4226-ba53-73a924cf1877") : secret "maas-api-e2e-inf-a-65f13b-serving-cert" not found
Jul 12 22:29:53.149947 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.149931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd6e5958-5ad7-4226-ba53-73a924cf1877-openshift-service-ca\") pod \"maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:53.160255 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.160225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dwv4\" (UniqueName: \"kubernetes.io/projected/bd6e5958-5ad7-4226-ba53-73a924cf1877-kube-api-access-2dwv4\") pod \"maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:53.311630 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.311596    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:53.579131 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.579040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:53.655522 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.655490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd6e5958-5ad7-4226-ba53-73a924cf1877-maas-api-tls\") pod \"maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:53.658186 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.658158    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd6e5958-5ad7-4226-ba53-73a924cf1877-maas-api-tls\") pod \"maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:53.678922 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.678887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:53.813958 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.813924    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:53.946002 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:53.945881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"]
Jul 12 22:29:53.949138 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:29:53.949098    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd6e5958_5ad7_4226_ba53_73a924cf1877.slice/crio-9d6a6d577de815c8f78cff29db6d3d5d93a839d48f4284a42783601a69b722eb WatchSource:0}: Error finding container 9d6a6d577de815c8f78cff29db6d3d5d93a839d48f4284a42783601a69b722eb: Status 404 returned error can't find the container with id 9d6a6d577de815c8f78cff29db6d3d5d93a839d48f4284a42783601a69b722eb
Jul 12 22:29:54.669100 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:54.669075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6" event={"ID":"bd6e5958-5ad7-4226-ba53-73a924cf1877","Type":"ContainerStarted","Data":"9d6a6d577de815c8f78cff29db6d3d5d93a839d48f4284a42783601a69b722eb"}
Jul 12 22:29:55.671615 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:55.671581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6" event={"ID":"bd6e5958-5ad7-4226-ba53-73a924cf1877","Type":"ContainerStarted","Data":"ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513"}
Jul 12 22:29:55.672117 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:55.671677    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:29:55.690629 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:55.690580    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6" podStartSLOduration=2.973906458 podStartE2EDuration="3.690566013s" totalImagesPullingTime="716.659555ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:29:55.688386314 +0000 UTC m=+2253.552072853" watchObservedRunningTime="2026-07-12 22:29:55.690566013 +0000 UTC m=+2253.554252526"
Jul 12 22:29:57.301619 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:57.301587    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:57.629715 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:57.629669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:57.927799 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:57.927685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:29:58.126938 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:29:58.126900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:00.133440 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.133401    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w"]
Jul 12 22:30:00.137550 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.137526    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96"]
Jul 12 22:30:00.137693 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.137641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w"
Jul 12 22:30:00.140158 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.140138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:30:00.140785 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.140767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96"
Jul 12 22:30:00.145558 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.145531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w"]
Jul 12 22:30:00.147784 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.147764    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96"]
Jul 12 22:30:00.151446 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.151424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w"
Jul 12 22:30:00.161250 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.161231    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96"
Jul 12 22:30:00.299991 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.299959    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w"]
Jul 12 22:30:00.302775 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:30:00.302750    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d0044e2_5388_42db_a627_bcd524b22da4.slice/crio-11ea4ce8864543964d099e67ca0a4e826caaf9f1285e1e821052d4c81899f096 WatchSource:0}: Error finding container 11ea4ce8864543964d099e67ca0a4e826caaf9f1285e1e821052d4c81899f096: Status 404 returned error can't find the container with id 11ea4ce8864543964d099e67ca0a4e826caaf9f1285e1e821052d4c81899f096
Jul 12 22:30:00.321716 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.321672    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96"]
Jul 12 22:30:00.324460 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:30:00.324436    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23afd62c_10f3_4e55_8139_44bea2dda45b.slice/crio-0d70af20eb18dc09c90b52513e63f86527c178654bbd99e7b0f9bf4cdbd92070 WatchSource:0}: Error finding container 0d70af20eb18dc09c90b52513e63f86527c178654bbd99e7b0f9bf4cdbd92070: Status 404 returned error can't find the container with id 0d70af20eb18dc09c90b52513e63f86527c178654bbd99e7b0f9bf4cdbd92070
Jul 12 22:30:00.696943 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.696840    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96" event={"ID":"23afd62c-10f3-4e55-8139-44bea2dda45b","Type":"ContainerStarted","Data":"07f1f3e6f9c655f5fd1a3dbcaeae207f84b9822c26249b1ad50c4bc4cbfd983d"}
Jul 12 22:30:00.696943 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.696895    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96" event={"ID":"23afd62c-10f3-4e55-8139-44bea2dda45b","Type":"ContainerStarted","Data":"0d70af20eb18dc09c90b52513e63f86527c178654bbd99e7b0f9bf4cdbd92070"}
Jul 12 22:30:00.698157 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.698131    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w" event={"ID":"8d0044e2-5388-42db-a627-bcd524b22da4","Type":"ContainerStarted","Data":"de5de29c3469e6ff23a9f97a5207fb662298d6e39f714cf060b901408f7ac991"}
Jul 12 22:30:00.698262 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.698172    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w" event={"ID":"8d0044e2-5388-42db-a627-bcd524b22da4","Type":"ContainerStarted","Data":"11ea4ce8864543964d099e67ca0a4e826caaf9f1285e1e821052d4c81899f096"}
Jul 12 22:30:00.713804 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.713752    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96" podStartSLOduration=0.713736052 podStartE2EDuration="713.736052ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:30:00.713470087 +0000 UTC m=+2258.577156600" watchObservedRunningTime="2026-07-12 22:30:00.713736052 +0000 UTC m=+2258.577422544"
Jul 12 22:30:00.728289 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.728239    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w" podStartSLOduration=0.728225115 podStartE2EDuration="728.225115ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:30:00.727974271 +0000 UTC m=+2258.591660784" watchObservedRunningTime="2026-07-12 22:30:00.728225115 +0000 UTC m=+2258.591911668"
Jul 12 22:30:00.893427 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.893384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:00.977430 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:00.977406    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:01.051393 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.051356    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"]
Jul 12 22:30:01.054749 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.054730    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:01.057677 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.057651    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6976fc-serving-cert\""
Jul 12 22:30:01.066421 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.066395    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"]
Jul 12 22:30:01.093767 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.093737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:01.226474 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.226374    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:01.226474 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.226435    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-maas-api-tls\") pod \"maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:01.226899 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.226558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkm5m\" (UniqueName: \"kubernetes.io/projected/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-kube-api-access-tkm5m\") pod \"maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:01.270044 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.270018    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:01.327687 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.327642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkm5m\" (UniqueName: \"kubernetes.io/projected/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-kube-api-access-tkm5m\") pod \"maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:01.327884 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.327725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:01.327884 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.327757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-maas-api-tls\") pod \"maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:01.328432 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.328402    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:01.330529 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.330509    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-maas-api-tls\") pod \"maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:01.337079 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.337059    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkm5m\" (UniqueName: \"kubernetes.io/projected/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-kube-api-access-tkm5m\") pod \"maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:01.359617 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.359585    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:30:01.368189 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.368162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:01.527720 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.527676    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"]
Jul 12 22:30:01.530130 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:30:01.530103    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ef8d2b_442b_4f76_b78f_3818f73f1f18.slice/crio-4c215dde455bfa442fd9369b80cb42228155fa17f3397ba4ab9f227478a0f25d WatchSource:0}: Error finding container 4c215dde455bfa442fd9369b80cb42228155fa17f3397ba4ab9f227478a0f25d: Status 404 returned error can't find the container with id 4c215dde455bfa442fd9369b80cb42228155fa17f3397ba4ab9f227478a0f25d
Jul 12 22:30:01.681298 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.681270    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:30:01.712785 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.712748    2581 generic.go:356] "Generic (PLEG): container finished" podID="8d0044e2-5388-42db-a627-bcd524b22da4" containerID="de5de29c3469e6ff23a9f97a5207fb662298d6e39f714cf060b901408f7ac991" exitCode=7
Jul 12 22:30:01.712960 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.712823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w" event={"ID":"8d0044e2-5388-42db-a627-bcd524b22da4","Type":"ContainerDied","Data":"de5de29c3469e6ff23a9f97a5207fb662298d6e39f714cf060b901408f7ac991"}
Jul 12 22:30:01.713034 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.713014    2581 scope.go:117] "RemoveContainer" containerID="de5de29c3469e6ff23a9f97a5207fb662298d6e39f714cf060b901408f7ac991"
Jul 12 22:30:01.714199 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.714175    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4" event={"ID":"c4ef8d2b-442b-4f76-b78f-3818f73f1f18","Type":"ContainerStarted","Data":"4c215dde455bfa442fd9369b80cb42228155fa17f3397ba4ab9f227478a0f25d"}
Jul 12 22:30:01.715748 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.715727    2581 generic.go:356] "Generic (PLEG): container finished" podID="23afd62c-10f3-4e55-8139-44bea2dda45b" containerID="07f1f3e6f9c655f5fd1a3dbcaeae207f84b9822c26249b1ad50c4bc4cbfd983d" exitCode=0
Jul 12 22:30:01.715847 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.715773    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96" event={"ID":"23afd62c-10f3-4e55-8139-44bea2dda45b","Type":"ContainerDied","Data":"07f1f3e6f9c655f5fd1a3dbcaeae207f84b9822c26249b1ad50c4bc4cbfd983d"}
Jul 12 22:30:01.845052 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.845016    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:01.943242 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:01.943207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:02.722520 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:02.722480    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w" event={"ID":"8d0044e2-5388-42db-a627-bcd524b22da4","Type":"ContainerStarted","Data":"3c8a2fec5ab3a5b6bd9efa3e7e53ba1b54c592f26ac919c82d50a4ca16cea0de"}
Jul 12 22:30:02.723918 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:02.723886    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4" event={"ID":"c4ef8d2b-442b-4f76-b78f-3818f73f1f18","Type":"ContainerStarted","Data":"b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f"}
Jul 12 22:30:02.724057 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:02.724042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:02.762242 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:02.762189    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4" podStartSLOduration=1.059791756 podStartE2EDuration="1.762168957s" totalImagesPullingTime="702.377201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:30:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:30:02.759361671 +0000 UTC m=+2260.623048183" watchObservedRunningTime="2026-07-12 22:30:02.762168957 +0000 UTC m=+2260.625855527"
Jul 12 22:30:02.859971 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:02.859945    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96"
Jul 12 22:30:03.729772 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:03.729738    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96"
Jul 12 22:30:03.729772 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:03.729747    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29731590-p4b96" event={"ID":"23afd62c-10f3-4e55-8139-44bea2dda45b","Type":"ContainerDied","Data":"0d70af20eb18dc09c90b52513e63f86527c178654bbd99e7b0f9bf4cdbd92070"}
Jul 12 22:30:03.730240 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:03.729797    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d70af20eb18dc09c90b52513e63f86527c178654bbd99e7b0f9bf4cdbd92070"
Jul 12 22:30:03.731617 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:03.731592    2581 generic.go:356] "Generic (PLEG): container finished" podID="8d0044e2-5388-42db-a627-bcd524b22da4" containerID="3c8a2fec5ab3a5b6bd9efa3e7e53ba1b54c592f26ac919c82d50a4ca16cea0de" exitCode=0
Jul 12 22:30:03.731718 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:03.731673    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w" event={"ID":"8d0044e2-5388-42db-a627-bcd524b22da4","Type":"ContainerDied","Data":"3c8a2fec5ab3a5b6bd9efa3e7e53ba1b54c592f26ac919c82d50a4ca16cea0de"}
Jul 12 22:30:03.731758 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:03.731741    2581 scope.go:117] "RemoveContainer" containerID="de5de29c3469e6ff23a9f97a5207fb662298d6e39f714cf060b901408f7ac991"
Jul 12 22:30:04.881261 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:04.881237    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w"
Jul 12 22:30:05.358375 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:05.358345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:05.745156 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:05.745074    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w"
Jul 12 22:30:05.745156 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:05.745083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w" event={"ID":"8d0044e2-5388-42db-a627-bcd524b22da4","Type":"ContainerDied","Data":"11ea4ce8864543964d099e67ca0a4e826caaf9f1285e1e821052d4c81899f096"}
Jul 12 22:30:05.745156 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:05.745126    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11ea4ce8864543964d099e67ca0a4e826caaf9f1285e1e821052d4c81899f096"
Jul 12 22:30:08.552394 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:08.552362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:08.738318 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:08.738289    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:30:13.911844 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:13.911808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:14.012757 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:14.012717    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:15.389965 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:15.389932    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:15.489885 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:15.489850    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:16.937044 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:16.937003    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:30:22.667786 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:22.667756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:22.765098 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:22.765060    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:22.793342 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:22.793313    2581 scope.go:117] "RemoveContainer" containerID="8652bd643ddafccfc00a0448e24344b194515c0b0e60fd571f98618f2e53a670"
Jul 12 22:30:50.931442 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:50.931402    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:30:56.539221 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:30:56.539184    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:31:09.016908 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:09.016871    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:10.043941 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.043904    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:10.183182 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.183148    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg"]
Jul 12 22:31:10.183491 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.183480    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d0044e2-5388-42db-a627-bcd524b22da4" containerName="cleanup"
Jul 12 22:31:10.183537 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.183493    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0044e2-5388-42db-a627-bcd524b22da4" containerName="cleanup"
Jul 12 22:31:10.183537 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.183499    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d0044e2-5388-42db-a627-bcd524b22da4" containerName="cleanup"
Jul 12 22:31:10.183537 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.183505    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d0044e2-5388-42db-a627-bcd524b22da4" containerName="cleanup"
Jul 12 22:31:10.183537 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.183527    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23afd62c-10f3-4e55-8139-44bea2dda45b" containerName="cleanup"
Jul 12 22:31:10.183537 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.183533    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="23afd62c-10f3-4e55-8139-44bea2dda45b" containerName="cleanup"
Jul 12 22:31:10.183720 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.183588    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d0044e2-5388-42db-a627-bcd524b22da4" containerName="cleanup"
Jul 12 22:31:10.183720 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.183601    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="23afd62c-10f3-4e55-8139-44bea2dda45b" containerName="cleanup"
Jul 12 22:31:10.186640 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.186622    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg"
Jul 12 22:31:10.189375 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.189354    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:31:10.198605 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.198580    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg"]
Jul 12 22:31:10.252261 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.252229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8397948f-b6fd-4371-8e8f-e66378f80767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg\" (UID: \"8397948f-b6fd-4371-8e8f-e66378f80767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg"
Jul 12 22:31:10.353296 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.353262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8397948f-b6fd-4371-8e8f-e66378f80767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg\" (UID: \"8397948f-b6fd-4371-8e8f-e66378f80767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg"
Jul 12 22:31:10.353898 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.353880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8397948f-b6fd-4371-8e8f-e66378f80767-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg\" (UID: \"8397948f-b6fd-4371-8e8f-e66378f80767\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg"
Jul 12 22:31:10.496447 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.496406    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg"
Jul 12 22:31:10.626465 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.626440    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg"]
Jul 12 22:31:10.628565 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:31:10.628533    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8397948f_b6fd_4371_8e8f_e66378f80767.slice/crio-220067deb3f79719f6efcba1ee3fd89039cd8de5eeec4a2c60b7a4d369d79738 WatchSource:0}: Error finding container 220067deb3f79719f6efcba1ee3fd89039cd8de5eeec4a2c60b7a4d369d79738: Status 404 returned error can't find the container with id 220067deb3f79719f6efcba1ee3fd89039cd8de5eeec4a2c60b7a4d369d79738
Jul 12 22:31:10.782239 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.782207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:10.884462 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:10.884433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:11.078575 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:11.078538    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg" event={"ID":"8397948f-b6fd-4371-8e8f-e66378f80767","Type":"ContainerStarted","Data":"ba6c3bce2f1e94202f5dab67e5b0065ba41c636903ebfc1f029134cf27b6d1b8"}
Jul 12 22:31:11.078987 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:11.078618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg" event={"ID":"8397948f-b6fd-4371-8e8f-e66378f80767","Type":"ContainerStarted","Data":"220067deb3f79719f6efcba1ee3fd89039cd8de5eeec4a2c60b7a4d369d79738"}
Jul 12 22:31:11.101296 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:11.101245    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg" podStartSLOduration=1.101228325 podStartE2EDuration="1.101228325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:31:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:31:11.100006534 +0000 UTC m=+2328.963693047" watchObservedRunningTime="2026-07-12 22:31:11.101228325 +0000 UTC m=+2328.964914837"
Jul 12 22:31:12.085120 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:12.085087    2581 generic.go:356] "Generic (PLEG): container finished" podID="8397948f-b6fd-4371-8e8f-e66378f80767" containerID="ba6c3bce2f1e94202f5dab67e5b0065ba41c636903ebfc1f029134cf27b6d1b8" exitCode=0
Jul 12 22:31:12.085516 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:12.085183    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg" event={"ID":"8397948f-b6fd-4371-8e8f-e66378f80767","Type":"ContainerDied","Data":"ba6c3bce2f1e94202f5dab67e5b0065ba41c636903ebfc1f029134cf27b6d1b8"}
Jul 12 22:31:13.224991 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:13.224963    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg"
Jul 12 22:31:13.276515 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:13.276484    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8397948f-b6fd-4371-8e8f-e66378f80767-maas-api-service-ca\") pod \"8397948f-b6fd-4371-8e8f-e66378f80767\" (UID: \"8397948f-b6fd-4371-8e8f-e66378f80767\") "
Jul 12 22:31:13.276899 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:13.276878    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8397948f-b6fd-4371-8e8f-e66378f80767-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8397948f-b6fd-4371-8e8f-e66378f80767" (UID: "8397948f-b6fd-4371-8e8f-e66378f80767"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:31:13.377607 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:13.377525    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8397948f-b6fd-4371-8e8f-e66378f80767-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:31:14.096354 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:14.096321    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg"
Jul 12 22:31:14.096354 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:14.096349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg" event={"ID":"8397948f-b6fd-4371-8e8f-e66378f80767","Type":"ContainerDied","Data":"220067deb3f79719f6efcba1ee3fd89039cd8de5eeec4a2c60b7a4d369d79738"}
Jul 12 22:31:14.096623 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:14.096394    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="220067deb3f79719f6efcba1ee3fd89039cd8de5eeec4a2c60b7a4d369d79738"
Jul 12 22:31:16.179437 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:16.179399    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:31:20.672768 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:20.672725    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"]
Jul 12 22:31:20.673215 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:20.672999    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6" podUID="bd6e5958-5ad7-4226-ba53-73a924cf1877" containerName="maas-api" containerID="cri-o://ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513" gracePeriod=30
Jul 12 22:31:20.697174 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:20.697142    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w"]
Jul 12 22:31:20.700962 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:20.700927    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:20.701362 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:20.701344    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-65f13b-29731590-lq89w"]
Jul 12 22:31:20.924945 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:20.924868    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:31:21.045983 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.045947    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd6e5958-5ad7-4226-ba53-73a924cf1877-openshift-service-ca\") pod \"bd6e5958-5ad7-4226-ba53-73a924cf1877\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") "
Jul 12 22:31:21.045983 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.045984    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd6e5958-5ad7-4226-ba53-73a924cf1877-maas-api-tls\") pod \"bd6e5958-5ad7-4226-ba53-73a924cf1877\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") "
Jul 12 22:31:21.046220 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.046005    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dwv4\" (UniqueName: \"kubernetes.io/projected/bd6e5958-5ad7-4226-ba53-73a924cf1877-kube-api-access-2dwv4\") pod \"bd6e5958-5ad7-4226-ba53-73a924cf1877\" (UID: \"bd6e5958-5ad7-4226-ba53-73a924cf1877\") "
Jul 12 22:31:21.046326 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.046303    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd6e5958-5ad7-4226-ba53-73a924cf1877-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd6e5958-5ad7-4226-ba53-73a924cf1877" (UID: "bd6e5958-5ad7-4226-ba53-73a924cf1877"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:31:21.048143 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.048113    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd6e5958-5ad7-4226-ba53-73a924cf1877-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd6e5958-5ad7-4226-ba53-73a924cf1877" (UID: "bd6e5958-5ad7-4226-ba53-73a924cf1877"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:31:21.048238 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.048180    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd6e5958-5ad7-4226-ba53-73a924cf1877-kube-api-access-2dwv4" (OuterVolumeSpecName: "kube-api-access-2dwv4") pod "bd6e5958-5ad7-4226-ba53-73a924cf1877" (UID: "bd6e5958-5ad7-4226-ba53-73a924cf1877"). InnerVolumeSpecName "kube-api-access-2dwv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:31:21.131439 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.131410    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd6e5958-5ad7-4226-ba53-73a924cf1877" containerID="ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513" exitCode=0
Jul 12 22:31:21.131609 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.131451    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"
Jul 12 22:31:21.131609 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.131490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6" event={"ID":"bd6e5958-5ad7-4226-ba53-73a924cf1877","Type":"ContainerDied","Data":"ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513"}
Jul 12 22:31:21.131609 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.131543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6" event={"ID":"bd6e5958-5ad7-4226-ba53-73a924cf1877","Type":"ContainerDied","Data":"9d6a6d577de815c8f78cff29db6d3d5d93a839d48f4284a42783601a69b722eb"}
Jul 12 22:31:21.131609 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.131570    2581 scope.go:117] "RemoveContainer" containerID="ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513"
Jul 12 22:31:21.140825 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.140808    2581 scope.go:117] "RemoveContainer" containerID="ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513"
Jul 12 22:31:21.141121 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:31:21.141100    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513\": container with ID starting with ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513 not found: ID does not exist" containerID="ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513"
Jul 12 22:31:21.141183 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.141130    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513"} err="failed to get container status \"ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513\": rpc error: code = NotFound desc = could not find container \"ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513\": container with ID starting with ea03a0c879a721324fca865266f76ea7546274eeee4dcf10172e6e8bec7c9513 not found: ID does not exist"
Jul 12 22:31:21.147329 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.147308    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd6e5958-5ad7-4226-ba53-73a924cf1877-openshift-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:31:21.147426 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.147332    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd6e5958-5ad7-4226-ba53-73a924cf1877-maas-api-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:31:21.147426 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.147346    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dwv4\" (UniqueName: \"kubernetes.io/projected/bd6e5958-5ad7-4226-ba53-73a924cf1877-kube-api-access-2dwv4\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:31:21.157840 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.157798    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"]
Jul 12 22:31:21.159825 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:21.159805    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-65f13b-749d59978b-gnnh6"]
Jul 12 22:31:22.669126 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:22.669095    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d0044e2-5388-42db-a627-bcd524b22da4" path="/var/lib/kubelet/pods/8d0044e2-5388-42db-a627-bcd524b22da4/volumes"
Jul 12 22:31:22.669482 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:22.669464    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd6e5958-5ad7-4226-ba53-73a924cf1877" path="/var/lib/kubelet/pods/bd6e5958-5ad7-4226-ba53-73a924cf1877/volumes"
Jul 12 22:31:25.265914 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:25.265883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:27.341653 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:27.341618    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:31:28.403555 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:28.403525    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:31.593970 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:31.593934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:31.694044 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:31.694011    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:35.961715 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:35.961668    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:36.172671 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.172636    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:36.289975 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.289894    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx"]
Jul 12 22:31:36.290251 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.290239    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8397948f-b6fd-4371-8e8f-e66378f80767" containerName="revoke-keys"
Jul 12 22:31:36.290294 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.290253    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8397948f-b6fd-4371-8e8f-e66378f80767" containerName="revoke-keys"
Jul 12 22:31:36.290294 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.290266    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd6e5958-5ad7-4226-ba53-73a924cf1877" containerName="maas-api"
Jul 12 22:31:36.290294 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.290271    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd6e5958-5ad7-4226-ba53-73a924cf1877" containerName="maas-api"
Jul 12 22:31:36.290390 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.290333    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d0044e2-5388-42db-a627-bcd524b22da4" containerName="cleanup"
Jul 12 22:31:36.290390 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.290342    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8397948f-b6fd-4371-8e8f-e66378f80767" containerName="revoke-keys"
Jul 12 22:31:36.290390 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.290350    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd6e5958-5ad7-4226-ba53-73a924cf1877" containerName="maas-api"
Jul 12 22:31:36.293457 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.293440    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx"
Jul 12 22:31:36.296216 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.296194    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:31:36.301238 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.301217    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx"]
Jul 12 22:31:36.389203 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.389162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4cc2e98-b9b3-4150-b0a7-5357103ed232-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6976fc-797cx\" (UID: \"c4cc2e98-b9b3-4150-b0a7-5357103ed232\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx"
Jul 12 22:31:36.489774 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.489728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4cc2e98-b9b3-4150-b0a7-5357103ed232-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6976fc-797cx\" (UID: \"c4cc2e98-b9b3-4150-b0a7-5357103ed232\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx"
Jul 12 22:31:36.490370 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.490349    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4cc2e98-b9b3-4150-b0a7-5357103ed232-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-6976fc-797cx\" (UID: \"c4cc2e98-b9b3-4150-b0a7-5357103ed232\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx"
Jul 12 22:31:36.604715 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.604674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx"
Jul 12 22:31:36.758036 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.758010    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx"]
Jul 12 22:31:36.760184 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:31:36.760159    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4cc2e98_b9b3_4150_b0a7_5357103ed232.slice/crio-33a3430cb148966d7566b745b549ea8825ff83aaeb933c65cdba5467e3b19585 WatchSource:0}: Error finding container 33a3430cb148966d7566b745b549ea8825ff83aaeb933c65cdba5467e3b19585: Status 404 returned error can't find the container with id 33a3430cb148966d7566b745b549ea8825ff83aaeb933c65cdba5467e3b19585
Jul 12 22:31:36.808319 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.808291    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:36.907549 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:36.907413    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:37.211723 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:37.211612    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx" event={"ID":"c4cc2e98-b9b3-4150-b0a7-5357103ed232","Type":"ContainerStarted","Data":"cfa24dc19e481a5495790ea6cac28411078306724118bc2b0dceb8242681fb52"}
Jul 12 22:31:37.211723 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:37.211664    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx" event={"ID":"c4cc2e98-b9b3-4150-b0a7-5357103ed232","Type":"ContainerStarted","Data":"33a3430cb148966d7566b745b549ea8825ff83aaeb933c65cdba5467e3b19585"}
Jul 12 22:31:37.227992 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:37.227929    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx" podStartSLOduration=1.227911031 podStartE2EDuration="1.227911031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:31:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:31:37.227533571 +0000 UTC m=+2355.091220106" watchObservedRunningTime="2026-07-12 22:31:37.227911031 +0000 UTC m=+2355.091597545"
Jul 12 22:31:38.218232 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:38.218194    2581 generic.go:356] "Generic (PLEG): container finished" podID="c4cc2e98-b9b3-4150-b0a7-5357103ed232" containerID="cfa24dc19e481a5495790ea6cac28411078306724118bc2b0dceb8242681fb52" exitCode=0
Jul 12 22:31:38.218609 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:38.218256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx" event={"ID":"c4cc2e98-b9b3-4150-b0a7-5357103ed232","Type":"ContainerDied","Data":"cfa24dc19e481a5495790ea6cac28411078306724118bc2b0dceb8242681fb52"}
Jul 12 22:31:39.352293 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:39.352269    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx"
Jul 12 22:31:39.414191 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:39.414155    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4cc2e98-b9b3-4150-b0a7-5357103ed232-maas-api-service-ca\") pod \"c4cc2e98-b9b3-4150-b0a7-5357103ed232\" (UID: \"c4cc2e98-b9b3-4150-b0a7-5357103ed232\") "
Jul 12 22:31:39.414508 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:39.414487    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4cc2e98-b9b3-4150-b0a7-5357103ed232-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c4cc2e98-b9b3-4150-b0a7-5357103ed232" (UID: "c4cc2e98-b9b3-4150-b0a7-5357103ed232"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:31:39.515847 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:39.515757    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4cc2e98-b9b3-4150-b0a7-5357103ed232-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:31:40.229448 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:40.229419    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx"
Jul 12 22:31:40.229448 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:40.229441    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-6976fc-797cx" event={"ID":"c4cc2e98-b9b3-4150-b0a7-5357103ed232","Type":"ContainerDied","Data":"33a3430cb148966d7566b745b549ea8825ff83aaeb933c65cdba5467e3b19585"}
Jul 12 22:31:40.229873 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:40.229484    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33a3430cb148966d7566b745b549ea8825ff83aaeb933c65cdba5467e3b19585"
Jul 12 22:31:46.781419 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:46.781388    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"]
Jul 12 22:31:46.781824 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:46.781605    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4" podUID="c4ef8d2b-442b-4f76-b78f-3818f73f1f18" containerName="maas-api" containerID="cri-o://b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f" gracePeriod=30
Jul 12 22:31:46.824416 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:46.824383    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:47.042469 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.042408    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:31:47.087032 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.086996    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkm5m\" (UniqueName: \"kubernetes.io/projected/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-kube-api-access-tkm5m\") pod \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") "
Jul 12 22:31:47.087197 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.087049    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-maas-api-tls\") pod \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") "
Jul 12 22:31:47.087197 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.087172    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-openshift-service-ca\") pod \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\" (UID: \"c4ef8d2b-442b-4f76-b78f-3818f73f1f18\") "
Jul 12 22:31:47.087503 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.087479    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4ef8d2b-442b-4f76-b78f-3818f73f1f18" (UID: "c4ef8d2b-442b-4f76-b78f-3818f73f1f18"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:31:47.089231 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.089203    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4ef8d2b-442b-4f76-b78f-3818f73f1f18" (UID: "c4ef8d2b-442b-4f76-b78f-3818f73f1f18"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:31:47.089231 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.089207    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-kube-api-access-tkm5m" (OuterVolumeSpecName: "kube-api-access-tkm5m") pod "c4ef8d2b-442b-4f76-b78f-3818f73f1f18" (UID: "c4ef8d2b-442b-4f76-b78f-3818f73f1f18"). InnerVolumeSpecName "kube-api-access-tkm5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:31:47.188215 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.188173    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-openshift-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:31:47.188215 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.188204    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkm5m\" (UniqueName: \"kubernetes.io/projected/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-kube-api-access-tkm5m\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:31:47.188215 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.188214    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4ef8d2b-442b-4f76-b78f-3818f73f1f18-maas-api-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:31:47.265893 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.265861    2581 generic.go:356] "Generic (PLEG): container finished" podID="c4ef8d2b-442b-4f76-b78f-3818f73f1f18" containerID="b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f" exitCode=0
Jul 12 22:31:47.266108 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.265903    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"
Jul 12 22:31:47.266108 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.265947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4" event={"ID":"c4ef8d2b-442b-4f76-b78f-3818f73f1f18","Type":"ContainerDied","Data":"b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f"}
Jul 12 22:31:47.266108 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.266043    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4" event={"ID":"c4ef8d2b-442b-4f76-b78f-3818f73f1f18","Type":"ContainerDied","Data":"4c215dde455bfa442fd9369b80cb42228155fa17f3397ba4ab9f227478a0f25d"}
Jul 12 22:31:47.266108 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.266075    2581 scope.go:117] "RemoveContainer" containerID="b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f"
Jul 12 22:31:47.275433 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.275416    2581 scope.go:117] "RemoveContainer" containerID="b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f"
Jul 12 22:31:47.275677 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:31:47.275660    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f\": container with ID starting with b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f not found: ID does not exist" containerID="b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f"
Jul 12 22:31:47.275758 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.275687    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f"} err="failed to get container status \"b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f\": rpc error: code = NotFound desc = could not find container \"b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f\": container with ID starting with b21242cbe6e21671eed08b4694fbe79a752a41ed2df6028c34baa49c90b2854f not found: ID does not exist"
Jul 12 22:31:47.292358 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.292326    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"]
Jul 12 22:31:47.298176 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:47.298116    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6976fc-69558f6c9f-99xz4"]
Jul 12 22:31:48.669085 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:48.669055    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4ef8d2b-442b-4f76-b78f-3818f73f1f18" path="/var/lib/kubelet/pods/c4ef8d2b-442b-4f76-b78f-3818f73f1f18/volumes"
Jul 12 22:31:49.849867 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:49.849830    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:31:51.421895 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:51.421845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:57.171476 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:57.171446    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:31:57.278387 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:31:57.278353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:02.142508 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:02.142473    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:02.391379 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:02.391329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:02.704391 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:02.704357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:03.027742 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.027653    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"]
Jul 12 22:32:03.028011 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.027998    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ef8d2b-442b-4f76-b78f-3818f73f1f18" containerName="maas-api"
Jul 12 22:32:03.028052 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.028012    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ef8d2b-442b-4f76-b78f-3818f73f1f18" containerName="maas-api"
Jul 12 22:32:03.028052 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.028022    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4cc2e98-b9b3-4150-b0a7-5357103ed232" containerName="revoke-keys"
Jul 12 22:32:03.028052 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.028027    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4cc2e98-b9b3-4150-b0a7-5357103ed232" containerName="revoke-keys"
Jul 12 22:32:03.028164 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.028085    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4cc2e98-b9b3-4150-b0a7-5357103ed232" containerName="revoke-keys"
Jul 12 22:32:03.028164 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.028094    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ef8d2b-442b-4f76-b78f-3818f73f1f18" containerName="maas-api"
Jul 12 22:32:03.031119 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.031102    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.033969 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.033946    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-23b6cb-openshift-default-dockercfg-kbr2n\""
Jul 12 22:32:03.045139 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.045113    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"]
Jul 12 22:32:03.078463 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.078429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:03.133492 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.133454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-podinfo\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.133492 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.133493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hskb4\" (UniqueName: \"kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-kube-api-access-hskb4\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.133743 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.133518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-data\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.133743 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.133604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-socket\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.133743 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.133648    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istiod-ca-cert\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.133743 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.133672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-envoy\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.133743 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.133691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-token\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.133906 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.133752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-certs\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.133906 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.133792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-credential-socket\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.234803 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.234768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istiod-ca-cert\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.234803 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.234811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-envoy\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235302 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.234828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-token\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235302 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.234940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-certs\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235302 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.234976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-credential-socket\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235302 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.235027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-podinfo\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235302 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.235056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hskb4\" (UniqueName: \"kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-kube-api-access-hskb4\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235302 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.235089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-data\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235302 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.235155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-socket\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235677 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.235338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-credential-socket\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235677 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.235391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-certs\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235677 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.235495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-socket\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235677 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.235526    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-data\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.235677 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.235575    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istiod-ca-cert\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.237167 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.237145    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-envoy\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.237476 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.237457    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-podinfo\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.253973 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.253944    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-token\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.254103 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.254029    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hskb4\" (UniqueName: \"kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-kube-api-access-hskb4\") pod \"e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") " pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.340975 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.340928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:03.463581 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.463546    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:03.491217 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.491194    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"]
Jul 12 22:32:03.493850 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:32:03.493818    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64b7a67_993e_4cbd_9867_3b5eea2aa551.slice/crio-e16a4cd4a55a0b03b5281ff4f8d89db4383f1fd73f5a6f83965a10f0865a2342 WatchSource:0}: Error finding container e16a4cd4a55a0b03b5281ff4f8d89db4383f1fd73f5a6f83965a10f0865a2342: Status 404 returned error can't find the container with id e16a4cd4a55a0b03b5281ff4f8d89db4383f1fd73f5a6f83965a10f0865a2342
Jul 12 22:32:03.495992 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:03.495974    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 12 22:32:04.355680 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:04.355643    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" event={"ID":"a64b7a67-993e-4cbd-9867-3b5eea2aa551","Type":"ContainerStarted","Data":"e16a4cd4a55a0b03b5281ff4f8d89db4383f1fd73f5a6f83965a10f0865a2342"}
Jul 12 22:32:05.905180 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:05.905144    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:32:05.905470 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:05.905217    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:32:05.905470 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:05.905251    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:32:06.368530 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:06.368494    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" event={"ID":"a64b7a67-993e-4cbd-9867-3b5eea2aa551","Type":"ContainerStarted","Data":"09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da"}
Jul 12 22:32:06.392097 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:06.392040    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" podStartSLOduration=1.9832919549999999 podStartE2EDuration="4.392021177s" totalImagesPullingTime="2.408729222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:32:06.390972236 +0000 UTC m=+2384.254658753" watchObservedRunningTime="2026-07-12 22:32:06.392021177 +0000 UTC m=+2384.255707690"
Jul 12 22:32:07.342063 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:07.342023    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:07.347188 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:07.347161    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:07.380225 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:07.380186    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:07.381274 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:07.381256    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:08.291348 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.291312    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:08.393741 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.393679    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:08.557807 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.557726    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"]
Jul 12 22:32:08.561594 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.561571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:08.564544 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.564496    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 22:32:08.564544 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.564524    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-23b6cb-serving-cert\""
Jul 12 22:32:08.564544 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.564542    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f4rcr\""
Jul 12 22:32:08.565693 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.565678    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 22:32:08.573576 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.573540    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"]
Jul 12 22:32:08.597597 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.597564    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:08.690049 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.690015    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a34600db-84e2-4bf4-8382-2fdd26748f67-maas-api-tls\") pod \"maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:08.690049 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.690063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34600db-84e2-4bf4-8382-2fdd26748f67-openshift-service-ca\") pod \"maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:08.690275 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.690087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7h2x\" (UniqueName: \"kubernetes.io/projected/a34600db-84e2-4bf4-8382-2fdd26748f67-kube-api-access-z7h2x\") pod \"maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:08.791059 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.791021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a34600db-84e2-4bf4-8382-2fdd26748f67-maas-api-tls\") pod \"maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:08.791205 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.791069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34600db-84e2-4bf4-8382-2fdd26748f67-openshift-service-ca\") pod \"maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:08.791205 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.791091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7h2x\" (UniqueName: \"kubernetes.io/projected/a34600db-84e2-4bf4-8382-2fdd26748f67-kube-api-access-z7h2x\") pod \"maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:08.791295 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:32:08.791204    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-serving-cert: secret "maas-api-e2e-api-a-23b6cb-serving-cert" not found
Jul 12 22:32:08.791295 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:32:08.791273    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34600db-84e2-4bf4-8382-2fdd26748f67-maas-api-tls podName:a34600db-84e2-4bf4-8382-2fdd26748f67 nodeName:}" failed. No retries permitted until 2026-07-12 22:32:09.291252858 +0000 UTC m=+2387.154939350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a34600db-84e2-4bf4-8382-2fdd26748f67-maas-api-tls") pod "maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg" (UID: "a34600db-84e2-4bf4-8382-2fdd26748f67") : secret "maas-api-e2e-api-a-23b6cb-serving-cert" not found
Jul 12 22:32:08.791805 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.791788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34600db-84e2-4bf4-8382-2fdd26748f67-openshift-service-ca\") pod \"maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:08.800523 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.800496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7h2x\" (UniqueName: \"kubernetes.io/projected/a34600db-84e2-4bf4-8382-2fdd26748f67-kube-api-access-z7h2x\") pod \"maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:08.914128 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:08.914092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:09.054276 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:09.054247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:09.154934 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:09.154897    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:09.296772 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:09.296655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a34600db-84e2-4bf4-8382-2fdd26748f67-maas-api-tls\") pod \"maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:09.299049 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:09.299027    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a34600db-84e2-4bf4-8382-2fdd26748f67-maas-api-tls\") pod \"maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:09.474448 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:09.474405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:09.608183 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:09.608158    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"]
Jul 12 22:32:09.610175 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:32:09.610152    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34600db_84e2_4bf4_8382_2fdd26748f67.slice/crio-ded19d7168ad1490db7b2c2b4555abb4cb1513dd95d8c329f62d66e3e62c6709 WatchSource:0}: Error finding container ded19d7168ad1490db7b2c2b4555abb4cb1513dd95d8c329f62d66e3e62c6709: Status 404 returned error can't find the container with id ded19d7168ad1490db7b2c2b4555abb4cb1513dd95d8c329f62d66e3e62c6709
Jul 12 22:32:10.396857 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:10.396770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg" event={"ID":"a34600db-84e2-4bf4-8382-2fdd26748f67","Type":"ContainerStarted","Data":"fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396"}
Jul 12 22:32:10.396857 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:10.396835    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:10.396857 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:10.396851    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg" event={"ID":"a34600db-84e2-4bf4-8382-2fdd26748f67","Type":"ContainerStarted","Data":"ded19d7168ad1490db7b2c2b4555abb4cb1513dd95d8c329f62d66e3e62c6709"}
Jul 12 22:32:10.415255 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:10.415199    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg" podStartSLOduration=1.9443829959999999 podStartE2EDuration="2.415183544s" totalImagesPullingTime="470.800548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:32:10.414316306 +0000 UTC m=+2388.278002839" watchObservedRunningTime="2026-07-12 22:32:10.415183544 +0000 UTC m=+2388.278870057"
Jul 12 22:32:12.048091 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:12.048058    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:12.148197 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:12.148168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:12.440478 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:12.440444    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:32:12.809382 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:12.809271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:13.263775 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:13.263723    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:13.601668 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:13.601619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:14.176304 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:14.176267    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:16.407532 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.407498    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:16.649685 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.649651    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:16.738444 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.738362    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"]
Jul 12 22:32:16.740883 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.740853    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:16.743452 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.743428    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:16.746367 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.746349    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-7dcad0-serving-cert\""
Jul 12 22:32:16.754308 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.754284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"]
Jul 12 22:32:16.821707 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.821676    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:16.875724 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.873266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f1bb39b-2949-4a47-9e90-9ed489678dab-maas-api-tls\") pod \"maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:16.875724 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.873326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1bb39b-2949-4a47-9e90-9ed489678dab-openshift-service-ca\") pod \"maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:16.875724 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.873360    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lddmf\" (UniqueName: \"kubernetes.io/projected/2f1bb39b-2949-4a47-9e90-9ed489678dab-kube-api-access-lddmf\") pod \"maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:16.975014 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.974960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f1bb39b-2949-4a47-9e90-9ed489678dab-maas-api-tls\") pod \"maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:16.975232 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.975032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1bb39b-2949-4a47-9e90-9ed489678dab-openshift-service-ca\") pod \"maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:16.975232 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.975068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lddmf\" (UniqueName: \"kubernetes.io/projected/2f1bb39b-2949-4a47-9e90-9ed489678dab-kube-api-access-lddmf\") pod \"maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:16.975658 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:32:16.975631    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-serving-cert: secret "maas-api-e2e-api-b-7dcad0-serving-cert" not found
Jul 12 22:32:16.976661 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:32:16.976646    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f1bb39b-2949-4a47-9e90-9ed489678dab-maas-api-tls podName:2f1bb39b-2949-4a47-9e90-9ed489678dab nodeName:}" failed. No retries permitted until 2026-07-12 22:32:17.47662502 +0000 UTC m=+2395.340311530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2f1bb39b-2949-4a47-9e90-9ed489678dab-maas-api-tls") pod "maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz" (UID: "2f1bb39b-2949-4a47-9e90-9ed489678dab") : secret "maas-api-e2e-api-b-7dcad0-serving-cert" not found
Jul 12 22:32:16.976922 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.976555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1bb39b-2949-4a47-9e90-9ed489678dab-openshift-service-ca\") pod \"maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:16.985044 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:16.985020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lddmf\" (UniqueName: \"kubernetes.io/projected/2f1bb39b-2949-4a47-9e90-9ed489678dab-kube-api-access-lddmf\") pod \"maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:17.099740 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:17.099684    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:17.470182 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:17.470151    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:17.480419 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:17.480388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f1bb39b-2949-4a47-9e90-9ed489678dab-maas-api-tls\") pod \"maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:17.482960 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:17.482926    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f1bb39b-2949-4a47-9e90-9ed489678dab-maas-api-tls\") pod \"maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:17.572749 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:17.572681    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:17.656361 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:17.656328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:17.806027 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:17.806003    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"]
Jul 12 22:32:17.808988 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:32:17.808964    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1bb39b_2949_4a47_9e90_9ed489678dab.slice/crio-5f59e0fb8b0b48262b926e91e2856560302bf64556720e111798d5a863746820 WatchSource:0}: Error finding container 5f59e0fb8b0b48262b926e91e2856560302bf64556720e111798d5a863746820: Status 404 returned error can't find the container with id 5f59e0fb8b0b48262b926e91e2856560302bf64556720e111798d5a863746820
Jul 12 22:32:18.444933 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:18.444890    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz" event={"ID":"2f1bb39b-2949-4a47-9e90-9ed489678dab","Type":"ContainerStarted","Data":"410baea0f85aa521d0309229e690e167bc80d7ee9c7d9ea8d5eeafa7563b86fc"}
Jul 12 22:32:18.445127 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:18.444976    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz" event={"ID":"2f1bb39b-2949-4a47-9e90-9ed489678dab","Type":"ContainerStarted","Data":"5f59e0fb8b0b48262b926e91e2856560302bf64556720e111798d5a863746820"}
Jul 12 22:32:18.445127 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:18.445036    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:18.462919 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:18.462856    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz" podStartSLOduration=1.979587993 podStartE2EDuration="2.462836545s" totalImagesPullingTime="483.248552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:32:18.461854777 +0000 UTC m=+2396.325541315" watchObservedRunningTime="2026-07-12 22:32:18.462836545 +0000 UTC m=+2396.326523059"
Jul 12 22:32:20.457566 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:20.457528    2581 generic.go:356] "Generic (PLEG): container finished" podID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerID="09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da" exitCode=0
Jul 12 22:32:20.458033 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:20.457600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" event={"ID":"a64b7a67-993e-4cbd-9867-3b5eea2aa551","Type":"ContainerDied","Data":"09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da"}
Jul 12 22:32:20.458033 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:20.457993    2581 scope.go:117] "RemoveContainer" containerID="09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da"
Jul 12 22:32:20.459908 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:20.459881    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:32:20.460008 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:20.459947    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:32:20.460008 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:20.459978    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:32:21.115091 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:21.115062    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:21.464779 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:21.464669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" event={"ID":"a64b7a67-993e-4cbd-9867-3b5eea2aa551","Type":"ContainerStarted","Data":"882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df"}
Jul 12 22:32:22.341669 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:22.341632    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:22.342860 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:22.342832    2581 patch_prober.go:28] interesting pod/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 12 22:32:22.342973 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:22.342889    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 12 22:32:22.381039 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:22.381002    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:22.729155 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:22.729126    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:32:22.732073 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:22.732049    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:32:23.342171 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:23.342134    2581 patch_prober.go:28] interesting pod/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 12 22:32:23.342346 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:23.342189    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 12 22:32:24.342086 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:24.342048    2581 patch_prober.go:28] interesting pod/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 12 22:32:24.342548 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:24.342126    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 12 22:32:24.457460 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:24.457430    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:32:25.357078 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:25.357043    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:25.358325 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:25.358302    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:32:29.587671 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:29.587628    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:29.697573 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:29.697537    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:31.142868 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:31.142840    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:32:38.197529 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:38.197488    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:38.298451 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:38.298422    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:39.631132 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:39.631098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:39.731042 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:39.731006    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:39.889800 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:39.889679    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"]
Jul 12 22:32:39.889946 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:39.889918    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg" podUID="a34600db-84e2-4bf4-8382-2fdd26748f67" containerName="maas-api" containerID="cri-o://fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396" gracePeriod=30
Jul 12 22:32:39.916513 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:39.916469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:40.146390 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.146327    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:40.172599 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.172563    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a34600db-84e2-4bf4-8382-2fdd26748f67-maas-api-tls\") pod \"a34600db-84e2-4bf4-8382-2fdd26748f67\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") "
Jul 12 22:32:40.172810 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.172644    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34600db-84e2-4bf4-8382-2fdd26748f67-openshift-service-ca\") pod \"a34600db-84e2-4bf4-8382-2fdd26748f67\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") "
Jul 12 22:32:40.172810 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.172749    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7h2x\" (UniqueName: \"kubernetes.io/projected/a34600db-84e2-4bf4-8382-2fdd26748f67-kube-api-access-z7h2x\") pod \"a34600db-84e2-4bf4-8382-2fdd26748f67\" (UID: \"a34600db-84e2-4bf4-8382-2fdd26748f67\") "
Jul 12 22:32:40.173082 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.173055    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a34600db-84e2-4bf4-8382-2fdd26748f67-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a34600db-84e2-4bf4-8382-2fdd26748f67" (UID: "a34600db-84e2-4bf4-8382-2fdd26748f67"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:32:40.174734 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.174684    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a34600db-84e2-4bf4-8382-2fdd26748f67-kube-api-access-z7h2x" (OuterVolumeSpecName: "kube-api-access-z7h2x") pod "a34600db-84e2-4bf4-8382-2fdd26748f67" (UID: "a34600db-84e2-4bf4-8382-2fdd26748f67"). InnerVolumeSpecName "kube-api-access-z7h2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:32:40.174841 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.174737    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a34600db-84e2-4bf4-8382-2fdd26748f67-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a34600db-84e2-4bf4-8382-2fdd26748f67" (UID: "a34600db-84e2-4bf4-8382-2fdd26748f67"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:32:40.273665 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.273631    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34600db-84e2-4bf4-8382-2fdd26748f67-openshift-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:32:40.273665 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.273658    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7h2x\" (UniqueName: \"kubernetes.io/projected/a34600db-84e2-4bf4-8382-2fdd26748f67-kube-api-access-z7h2x\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:32:40.273665 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.273667    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a34600db-84e2-4bf4-8382-2fdd26748f67-maas-api-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:32:40.576171 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.576077    2581 generic.go:356] "Generic (PLEG): container finished" podID="a34600db-84e2-4bf4-8382-2fdd26748f67" containerID="fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396" exitCode=0
Jul 12 22:32:40.576171 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.576134    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"
Jul 12 22:32:40.576171 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.576137    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg" event={"ID":"a34600db-84e2-4bf4-8382-2fdd26748f67","Type":"ContainerDied","Data":"fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396"}
Jul 12 22:32:40.576435 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.576191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg" event={"ID":"a34600db-84e2-4bf4-8382-2fdd26748f67","Type":"ContainerDied","Data":"ded19d7168ad1490db7b2c2b4555abb4cb1513dd95d8c329f62d66e3e62c6709"}
Jul 12 22:32:40.576435 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.576223    2581 scope.go:117] "RemoveContainer" containerID="fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396"
Jul 12 22:32:40.585516 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.585499    2581 scope.go:117] "RemoveContainer" containerID="fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396"
Jul 12 22:32:40.585792 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:32:40.585767    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396\": container with ID starting with fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396 not found: ID does not exist" containerID="fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396"
Jul 12 22:32:40.585889 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.585798    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396"} err="failed to get container status \"fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396\": rpc error: code = NotFound desc = could not find container \"fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396\": container with ID starting with fd4331d1d87d2918aa66f16fdc7e612b5c8102be792eaaca08992286926b0396 not found: ID does not exist"
Jul 12 22:32:40.598533 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.598509    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"]
Jul 12 22:32:40.602079 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.602057    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-23b6cb-599df75c64-xt5bg"]
Jul 12 22:32:40.669377 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:40.669344    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a34600db-84e2-4bf4-8382-2fdd26748f67" path="/var/lib/kubelet/pods/a34600db-84e2-4bf4-8382-2fdd26748f67/volumes"
Jul 12 22:32:43.146862 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:43.146818    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:32:44.129862 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:44.129826    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:50.372277 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:50.372244    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:50.473187 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:50.473155    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:54.787124 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:54.787088    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"]
Jul 12 22:32:54.787780 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:54.787310    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerName="istio-proxy" containerID="cri-o://882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df" gracePeriod=30
Jul 12 22:32:54.803734 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:54.803693    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:55.020607 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.020571    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:55.137103 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.137068    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn"]
Jul 12 22:32:55.137419 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.137408    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a34600db-84e2-4bf4-8382-2fdd26748f67" containerName="maas-api"
Jul 12 22:32:55.137465 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.137421    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a34600db-84e2-4bf4-8382-2fdd26748f67" containerName="maas-api"
Jul 12 22:32:55.137503 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.137490    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a34600db-84e2-4bf4-8382-2fdd26748f67" containerName="maas-api"
Jul 12 22:32:55.142087 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.142066    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn"
Jul 12 22:32:55.145298 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.145276    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vr6tp\""
Jul 12 22:32:55.147983 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.147961    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn"]
Jul 12 22:32:55.202140 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.202105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b972a04-d615-4d5b-835c-504fc50f218d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn\" (UID: \"9b972a04-d615-4d5b-835c-504fc50f218d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn"
Jul 12 22:32:55.303298 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.303256    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b972a04-d615-4d5b-835c-504fc50f218d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn\" (UID: \"9b972a04-d615-4d5b-835c-504fc50f218d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn"
Jul 12 22:32:55.303904 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.303886    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b972a04-d615-4d5b-835c-504fc50f218d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn\" (UID: \"9b972a04-d615-4d5b-835c-504fc50f218d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn"
Jul 12 22:32:55.360288 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.360244    2581 patch_prober.go:28] interesting pod/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 12 22:32:55.360435 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.360319    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 12 22:32:55.453947 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.453858    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn"
Jul 12 22:32:55.586216 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.586179    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn"]
Jul 12 22:32:55.589203 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:32:55.589173    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b972a04_d615_4d5b_835c_504fc50f218d.slice/crio-b966c1fab4e6a8c1d17b3094320ad8998f2ddaf23759d552fadc723d9f8eb05c WatchSource:0}: Error finding container b966c1fab4e6a8c1d17b3094320ad8998f2ddaf23759d552fadc723d9f8eb05c: Status 404 returned error can't find the container with id b966c1fab4e6a8c1d17b3094320ad8998f2ddaf23759d552fadc723d9f8eb05c
Jul 12 22:32:55.657593 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.657557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn" event={"ID":"9b972a04-d615-4d5b-835c-504fc50f218d","Type":"ContainerStarted","Data":"b966c1fab4e6a8c1d17b3094320ad8998f2ddaf23759d552fadc723d9f8eb05c"}
Jul 12 22:32:55.794455 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.794430    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:55.900417 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:55.900394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:32:56.664731 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:56.664620    2581 generic.go:356] "Generic (PLEG): container finished" podID="9b972a04-d615-4d5b-835c-504fc50f218d" containerID="fed6155d0d7b096d95c40acd8974075b3e2584f19a5fd51f6612f327d88aa8b2" exitCode=0
Jul 12 22:32:56.668514 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:56.668482    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn" event={"ID":"9b972a04-d615-4d5b-835c-504fc50f218d","Type":"ContainerDied","Data":"fed6155d0d7b096d95c40acd8974075b3e2584f19a5fd51f6612f327d88aa8b2"}
Jul 12 22:32:57.800316 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:57.800291    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn"
Jul 12 22:32:57.929553 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:57.929460    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b972a04-d615-4d5b-835c-504fc50f218d-maas-api-service-ca\") pod \"9b972a04-d615-4d5b-835c-504fc50f218d\" (UID: \"9b972a04-d615-4d5b-835c-504fc50f218d\") "
Jul 12 22:32:57.929916 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:57.929880    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b972a04-d615-4d5b-835c-504fc50f218d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9b972a04-d615-4d5b-835c-504fc50f218d" (UID: "9b972a04-d615-4d5b-835c-504fc50f218d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:32:58.030569 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:58.030540    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b972a04-d615-4d5b-835c-504fc50f218d-maas-api-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:32:58.677946 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:58.677915    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn"
Jul 12 22:32:58.678074 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:58.677949    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn" event={"ID":"9b972a04-d615-4d5b-835c-504fc50f218d","Type":"ContainerDied","Data":"b966c1fab4e6a8c1d17b3094320ad8998f2ddaf23759d552fadc723d9f8eb05c"}
Jul 12 22:32:58.678074 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:32:58.677998    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b966c1fab4e6a8c1d17b3094320ad8998f2ddaf23759d552fadc723d9f8eb05c"
Jul 12 22:33:00.035012 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.034982    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:33:00.149049 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149016    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-token\") pod \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") "
Jul 12 22:33:00.149231 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149069    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-envoy\") pod \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") "
Jul 12 22:33:00.149231 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149126    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-credential-socket\") pod \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") "
Jul 12 22:33:00.149231 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149152    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-podinfo\") pod \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") "
Jul 12 22:33:00.149231 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149195    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-socket\") pod \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") "
Jul 12 22:33:00.149231 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149219    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istiod-ca-cert\") pod \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") "
Jul 12 22:33:00.149466 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149255    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-data\") pod \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") "
Jul 12 22:33:00.149466 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149281    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hskb4\" (UniqueName: \"kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-kube-api-access-hskb4\") pod \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") "
Jul 12 22:33:00.149466 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149306    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-certs\") pod \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\" (UID: \"a64b7a67-993e-4cbd-9867-3b5eea2aa551\") "
Jul 12 22:33:00.149466 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149440    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a64b7a67-993e-4cbd-9867-3b5eea2aa551" (UID: "a64b7a67-993e-4cbd-9867-3b5eea2aa551"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:33:00.149675 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149544    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a64b7a67-993e-4cbd-9867-3b5eea2aa551" (UID: "a64b7a67-993e-4cbd-9867-3b5eea2aa551"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:33:00.149766 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149681    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a64b7a67-993e-4cbd-9867-3b5eea2aa551" (UID: "a64b7a67-993e-4cbd-9867-3b5eea2aa551"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:33:00.149766 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149686    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-socket\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:00.149766 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149745    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-credential-socket\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:00.149766 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.149682    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a64b7a67-993e-4cbd-9867-3b5eea2aa551" (UID: "a64b7a67-993e-4cbd-9867-3b5eea2aa551"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:33:00.150229 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.150203    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-data" (OuterVolumeSpecName: "istio-data") pod "a64b7a67-993e-4cbd-9867-3b5eea2aa551" (UID: "a64b7a67-993e-4cbd-9867-3b5eea2aa551"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:33:00.151724 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.151677    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-token" (OuterVolumeSpecName: "istio-token") pod "a64b7a67-993e-4cbd-9867-3b5eea2aa551" (UID: "a64b7a67-993e-4cbd-9867-3b5eea2aa551"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:33:00.151724 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.151677    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-kube-api-access-hskb4" (OuterVolumeSpecName: "kube-api-access-hskb4") pod "a64b7a67-993e-4cbd-9867-3b5eea2aa551" (UID: "a64b7a67-993e-4cbd-9867-3b5eea2aa551"). InnerVolumeSpecName "kube-api-access-hskb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:33:00.151880 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.151845    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a64b7a67-993e-4cbd-9867-3b5eea2aa551" (UID: "a64b7a67-993e-4cbd-9867-3b5eea2aa551"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:33:00.151880 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.151851    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a64b7a67-993e-4cbd-9867-3b5eea2aa551" (UID: "a64b7a67-993e-4cbd-9867-3b5eea2aa551"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 22:33:00.250735 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.250662    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istiod-ca-cert\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:00.250735 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.250710    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-data\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:00.250735 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.250720    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hskb4\" (UniqueName: \"kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-kube-api-access-hskb4\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:00.250735 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.250730    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-workload-certs\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:00.250735 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.250739    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-token\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:00.250735 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.250746    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-envoy\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:00.250735 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.250753    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64b7a67-993e-4cbd-9867-3b5eea2aa551-istio-podinfo\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:00.689918 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.689890    2581 generic.go:356] "Generic (PLEG): container finished" podID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerID="882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df" exitCode=0
Jul 12 22:33:00.690065 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.689937    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"
Jul 12 22:33:00.690065 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.689936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" event={"ID":"a64b7a67-993e-4cbd-9867-3b5eea2aa551","Type":"ContainerDied","Data":"882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df"}
Jul 12 22:33:00.690168 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.690062    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng" event={"ID":"a64b7a67-993e-4cbd-9867-3b5eea2aa551","Type":"ContainerDied","Data":"e16a4cd4a55a0b03b5281ff4f8d89db4383f1fd73f5a6f83965a10f0865a2342"}
Jul 12 22:33:00.690168 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.690090    2581 scope.go:117] "RemoveContainer" containerID="882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df"
Jul 12 22:33:00.698930 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.698912    2581 scope.go:117] "RemoveContainer" containerID="09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da"
Jul 12 22:33:00.706919 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.706900    2581 scope.go:117] "RemoveContainer" containerID="882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df"
Jul 12 22:33:00.707185 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:33:00.707161    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df\": container with ID starting with 882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df not found: ID does not exist" containerID="882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df"
Jul 12 22:33:00.707234 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.707195    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df"} err="failed to get container status \"882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df\": rpc error: code = NotFound desc = could not find container \"882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df\": container with ID starting with 882251e631489319d151265a767dd94609b21b5c1ff1b1541a818579a15e15df not found: ID does not exist"
Jul 12 22:33:00.707234 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.707213    2581 scope.go:117] "RemoveContainer" containerID="09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da"
Jul 12 22:33:00.707362 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.707343    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"]
Jul 12 22:33:00.707485 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:33:00.707468    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da\": container with ID starting with 09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da not found: ID does not exist" containerID="09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da"
Jul 12 22:33:00.707527 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.707491    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da"} err="failed to get container status \"09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da\": rpc error: code = NotFound desc = could not find container \"09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da\": container with ID starting with 09207c28f4219c54298aae1f9a2cc955673132132bc9f3749f1123409f1fc2da not found: ID does not exist"
Jul 12 22:33:00.710861 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:00.710839    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-23b6cb-openshift-default-65cdcddfbc-cs2ng"]
Jul 12 22:33:02.669725 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:02.669676    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" path="/var/lib/kubelet/pods/a64b7a67-993e-4cbd-9867-3b5eea2aa551/volumes"
Jul 12 22:33:05.507037 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.507003    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"]
Jul 12 22:33:05.507465 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.507261    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz" podUID="2f1bb39b-2949-4a47-9e90-9ed489678dab" containerName="maas-api" containerID="cri-o://410baea0f85aa521d0309229e690e167bc80d7ee9c7d9ea8d5eeafa7563b86fc" gracePeriod=30
Jul 12 22:33:05.527908 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.527882    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:05.716595 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.716561    2581 generic.go:356] "Generic (PLEG): container finished" podID="2f1bb39b-2949-4a47-9e90-9ed489678dab" containerID="410baea0f85aa521d0309229e690e167bc80d7ee9c7d9ea8d5eeafa7563b86fc" exitCode=0
Jul 12 22:33:05.716797 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.716639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz" event={"ID":"2f1bb39b-2949-4a47-9e90-9ed489678dab","Type":"ContainerDied","Data":"410baea0f85aa521d0309229e690e167bc80d7ee9c7d9ea8d5eeafa7563b86fc"}
Jul 12 22:33:05.767276 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.767213    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:33:05.905197 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.905165    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lddmf\" (UniqueName: \"kubernetes.io/projected/2f1bb39b-2949-4a47-9e90-9ed489678dab-kube-api-access-lddmf\") pod \"2f1bb39b-2949-4a47-9e90-9ed489678dab\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") "
Jul 12 22:33:05.905409 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.905245    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f1bb39b-2949-4a47-9e90-9ed489678dab-maas-api-tls\") pod \"2f1bb39b-2949-4a47-9e90-9ed489678dab\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") "
Jul 12 22:33:05.905409 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.905266    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1bb39b-2949-4a47-9e90-9ed489678dab-openshift-service-ca\") pod \"2f1bb39b-2949-4a47-9e90-9ed489678dab\" (UID: \"2f1bb39b-2949-4a47-9e90-9ed489678dab\") "
Jul 12 22:33:05.905742 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.905687    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f1bb39b-2949-4a47-9e90-9ed489678dab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2f1bb39b-2949-4a47-9e90-9ed489678dab" (UID: "2f1bb39b-2949-4a47-9e90-9ed489678dab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:33:05.907380 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.907350    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f1bb39b-2949-4a47-9e90-9ed489678dab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2f1bb39b-2949-4a47-9e90-9ed489678dab" (UID: "2f1bb39b-2949-4a47-9e90-9ed489678dab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:33:05.907497 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:05.907415    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f1bb39b-2949-4a47-9e90-9ed489678dab-kube-api-access-lddmf" (OuterVolumeSpecName: "kube-api-access-lddmf") pod "2f1bb39b-2949-4a47-9e90-9ed489678dab" (UID: "2f1bb39b-2949-4a47-9e90-9ed489678dab"). InnerVolumeSpecName "kube-api-access-lddmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:33:06.006642 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:06.006608    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lddmf\" (UniqueName: \"kubernetes.io/projected/2f1bb39b-2949-4a47-9e90-9ed489678dab-kube-api-access-lddmf\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:06.006642 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:06.006638    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f1bb39b-2949-4a47-9e90-9ed489678dab-maas-api-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:06.006642 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:06.006647    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f1bb39b-2949-4a47-9e90-9ed489678dab-openshift-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:33:06.722247 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:06.722217    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"
Jul 12 22:33:06.722664 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:06.722258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz" event={"ID":"2f1bb39b-2949-4a47-9e90-9ed489678dab","Type":"ContainerDied","Data":"5f59e0fb8b0b48262b926e91e2856560302bf64556720e111798d5a863746820"}
Jul 12 22:33:06.722664 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:06.722318    2581 scope.go:117] "RemoveContainer" containerID="410baea0f85aa521d0309229e690e167bc80d7ee9c7d9ea8d5eeafa7563b86fc"
Jul 12 22:33:06.740129 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:06.740095    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"]
Jul 12 22:33:06.741980 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:06.741954    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7dcad0-6b47c58bb6-8m9cz"]
Jul 12 22:33:08.669820 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:08.669783    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f1bb39b-2949-4a47-9e90-9ed489678dab" path="/var/lib/kubelet/pods/2f1bb39b-2949-4a47-9e90-9ed489678dab/volumes"
Jul 12 22:33:08.745629 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:08.745598    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:33:10.229099 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:10.229063    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:16.050972 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:16.050934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:16.112606 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:16.112574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:20.878823 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:20.878787    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:21.091987 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.091942    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:21.435634 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.435597    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:21.705510 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.705421    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"]
Jul 12 22:33:21.705889 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.705871    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b972a04-d615-4d5b-835c-504fc50f218d" containerName="revoke-keys"
Jul 12 22:33:21.705993 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.705892    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b972a04-d615-4d5b-835c-504fc50f218d" containerName="revoke-keys"
Jul 12 22:33:21.705993 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.705912    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerName="istio-proxy"
Jul 12 22:33:21.705993 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.705922    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerName="istio-proxy"
Jul 12 22:33:21.705993 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.705942    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f1bb39b-2949-4a47-9e90-9ed489678dab" containerName="maas-api"
Jul 12 22:33:21.705993 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.705951    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f1bb39b-2949-4a47-9e90-9ed489678dab" containerName="maas-api"
Jul 12 22:33:21.706259 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.706055    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerName="istio-proxy"
Jul 12 22:33:21.706259 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.706069    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f1bb39b-2949-4a47-9e90-9ed489678dab" containerName="maas-api"
Jul 12 22:33:21.706259 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.706080    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b972a04-d615-4d5b-835c-504fc50f218d" containerName="revoke-keys"
Jul 12 22:33:21.706259 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.706092    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerName="istio-proxy"
Jul 12 22:33:21.710486 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.710466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.713260 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.713242    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-66fe58-openshift-default-dockercfg-9f6b4\""
Jul 12 22:33:21.720878 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.720857    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"]
Jul 12 22:33:21.737950 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.737907    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:21.738145 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.738109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-envoy\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.738210 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.738140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-data\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.738265 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.738224    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-socket\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.738303 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.738280    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-token\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.738344 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.738305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-credential-socket\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.738344 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.738324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istiod-ca-cert\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.738413 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.738349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-certs\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.738413 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.738389    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25jr5\" (UniqueName: \"kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-kube-api-access-25jr5\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.738476 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.738410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-podinfo\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.839746 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.839685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-envoy\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.839746 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.839745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-data\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.839962 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.839784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-socket\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.839962 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.839805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-token\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.839962 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.839823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-credential-socket\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.839962 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.839951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istiod-ca-cert\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.840171 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.840003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-certs\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.840171 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.840053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25jr5\" (UniqueName: \"kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-kube-api-access-25jr5\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.840171 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.840098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-podinfo\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.840326 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.840172    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-socket\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.840326 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.840235    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-data\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.840755 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.840719    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-certs\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.840899 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.840753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-credential-socket\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.840899 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.840852    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istiod-ca-cert\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.841907 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.841881    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-envoy\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.842818 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.842797    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-podinfo\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.849975 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.849951    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-token\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.850414 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.850396    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25jr5\" (UniqueName: \"kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-kube-api-access-25jr5\") pod \"e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") " pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:21.954444 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:21.954395    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:22.021708 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:22.021613    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:22.158605 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:22.158578    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"]
Jul 12 22:33:22.160814 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:33:22.160787    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e95dac7_2ca0_484a_8f21_a833ff1c4864.slice/crio-24bbf447aa20310c9210b061922360ee5541a83fe0e5f14ee240e3fada08e293 WatchSource:0}: Error finding container 24bbf447aa20310c9210b061922360ee5541a83fe0e5f14ee240e3fada08e293: Status 404 returned error can't find the container with id 24bbf447aa20310c9210b061922360ee5541a83fe0e5f14ee240e3fada08e293
Jul 12 22:33:22.162788 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:22.162756    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:33:22.162859 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:22.162820    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:33:22.162859 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:22.162847    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:33:22.808095 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:22.808063    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" event={"ID":"2e95dac7-2ca0-484a-8f21-a833ff1c4864","Type":"ContainerStarted","Data":"683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267"}
Jul 12 22:33:22.808309 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:22.808113    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" event={"ID":"2e95dac7-2ca0-484a-8f21-a833ff1c4864","Type":"ContainerStarted","Data":"24bbf447aa20310c9210b061922360ee5541a83fe0e5f14ee240e3fada08e293"}
Jul 12 22:33:22.834468 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:22.834422    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" podStartSLOduration=1.8344049089999999 podStartE2EDuration="1.834404909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:33:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:33:22.832395825 +0000 UTC m=+2460.696082365" watchObservedRunningTime="2026-07-12 22:33:22.834404909 +0000 UTC m=+2460.698091421"
Jul 12 22:33:23.022598 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:23.022491    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:23.024121 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:23.024089    2581 patch_prober.go:28] interesting pod/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 12 22:33:23.024247 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:23.024141    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 12 22:33:24.027256 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.027220    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:24.819341 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.819301    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:24.820282 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.820264    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:24.850594 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.850558    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:24.941058 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.941020    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:24.942466 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.942434    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"]
Jul 12 22:33:24.942875 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.942851    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerName="istio-proxy"
Jul 12 22:33:24.942875 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.942871    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a64b7a67-993e-4cbd-9867-3b5eea2aa551" containerName="istio-proxy"
Jul 12 22:33:24.947406 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.947386    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:24.950579 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.950554    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 12 22:33:24.950717 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.950576    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 12 22:33:24.950717 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.950621    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-66fe58-serving-cert\""
Jul 12 22:33:24.950717 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.950636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-f4rcr\""
Jul 12 22:33:24.957954 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.957930    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"]
Jul 12 22:33:24.965448 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.965423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tsvr\" (UniqueName: \"kubernetes.io/projected/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-kube-api-access-8tsvr\") pod \"maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:24.965569 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.965465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:24.965569 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:24.965537    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:25.016444 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.016415    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:25.066859 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.066822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tsvr\" (UniqueName: \"kubernetes.io/projected/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-kube-api-access-8tsvr\") pod \"maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:25.067264 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.066875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:25.067264 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.066925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:25.067264 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:33:25.067029    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-serving-cert: secret "maas-api-e2e-shared-a-66fe58-serving-cert" not found
Jul 12 22:33:25.067264 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:33:25.067112    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-maas-api-tls podName:8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca nodeName:}" failed. No retries permitted until 2026-07-12 22:33:25.567090508 +0000 UTC m=+2463.430776998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-maas-api-tls") pod "maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d" (UID: "8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca") : secret "maas-api-e2e-shared-a-66fe58-serving-cert" not found
Jul 12 22:33:25.067617 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.067598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:25.076448 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.076385    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tsvr\" (UniqueName: \"kubernetes.io/projected/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-kube-api-access-8tsvr\") pod \"maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:25.266070 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.266038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:25.570885 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.570849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:25.573339 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.573310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:25.580615 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.580589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:25.690998 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.690964    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:25.860014 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.859985    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:25.995124 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:25.995094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"]
Jul 12 22:33:25.997248 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:33:25.997222    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eebac9a_c0fa_4f4d_a2ab_47616ab4c8ca.slice/crio-ffef0d89b9e588868ab2fc884825eb8792986090ca26a46073f026f5b0757f4b WatchSource:0}: Error finding container ffef0d89b9e588868ab2fc884825eb8792986090ca26a46073f026f5b0757f4b: Status 404 returned error can't find the container with id ffef0d89b9e588868ab2fc884825eb8792986090ca26a46073f026f5b0757f4b
Jul 12 22:33:26.830498 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:26.830391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d" event={"ID":"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca","Type":"ContainerStarted","Data":"fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f"}
Jul 12 22:33:26.830498 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:26.830468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d" event={"ID":"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca","Type":"ContainerStarted","Data":"ffef0d89b9e588868ab2fc884825eb8792986090ca26a46073f026f5b0757f4b"}
Jul 12 22:33:26.830961 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:26.830515    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:29.265148 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:29.265110    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:29.600668 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:29.600638    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:29.902486 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:29.902394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:30.001907 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:30.001867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:30.147653 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:30.147578    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d" podStartSLOduration=5.741057496 podStartE2EDuration="6.147554395s" totalImagesPullingTime="406.496899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:33:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:33:26.847972793 +0000 UTC m=+2464.711659306" watchObservedRunningTime="2026-07-12 22:33:30.147554395 +0000 UTC m=+2468.011240909"
Jul 12 22:33:30.148978 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:30.148957    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:33:32.841908 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:32.841878    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:33:33.127734 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.127617    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:33.202145 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.202114    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"]
Jul 12 22:33:33.206257 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.206227    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:33.209066 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.209044    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-7a7f11-serving-cert\""
Jul 12 22:33:33.221188 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.221153    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:33.221985 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.221965    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"]
Jul 12 22:33:33.244775 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.244746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzmdr\" (UniqueName: \"kubernetes.io/projected/cef137e0-538d-4803-a961-35aba5d94d29-kube-api-access-vzmdr\") pod \"maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:33.244932 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.244912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef137e0-538d-4803-a961-35aba5d94d29-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:33.244987 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.244946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef137e0-538d-4803-a961-35aba5d94d29-maas-api-tls\") pod \"maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:33.296985 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.296953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:33.346130 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.346093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef137e0-538d-4803-a961-35aba5d94d29-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:33.346130 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.346131    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef137e0-538d-4803-a961-35aba5d94d29-maas-api-tls\") pod \"maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:33.346391 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.346149    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmdr\" (UniqueName: \"kubernetes.io/projected/cef137e0-538d-4803-a961-35aba5d94d29-kube-api-access-vzmdr\") pod \"maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:33.346838 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.346802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef137e0-538d-4803-a961-35aba5d94d29-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:33.348631 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.348607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef137e0-538d-4803-a961-35aba5d94d29-maas-api-tls\") pod \"maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:33.354880 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.354855    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzmdr\" (UniqueName: \"kubernetes.io/projected/cef137e0-538d-4803-a961-35aba5d94d29-kube-api-access-vzmdr\") pod \"maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:33.397597 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.397476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:33.520403 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.520372    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:33.695185 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.692807    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"]
Jul 12 22:33:33.695185 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:33:33.695099    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef137e0_538d_4803_a961_35aba5d94d29.slice/crio-f9e187a3cf0ad02dda37b841dd7605aba854a2f4115828560d066230e9e76705 WatchSource:0}: Error finding container f9e187a3cf0ad02dda37b841dd7605aba854a2f4115828560d066230e9e76705: Status 404 returned error can't find the container with id f9e187a3cf0ad02dda37b841dd7605aba854a2f4115828560d066230e9e76705
Jul 12 22:33:33.784729 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.784581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:33.867736 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.867651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx" event={"ID":"cef137e0-538d-4803-a961-35aba5d94d29","Type":"ContainerStarted","Data":"f9e187a3cf0ad02dda37b841dd7605aba854a2f4115828560d066230e9e76705"}
Jul 12 22:33:33.878940 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:33.878900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:34.878931 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:34.878641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx" event={"ID":"cef137e0-538d-4803-a961-35aba5d94d29","Type":"ContainerStarted","Data":"9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750"}
Jul 12 22:33:34.879537 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:34.879515    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:34.898398 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:34.898337    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx" podStartSLOduration=1.509274597 podStartE2EDuration="1.898314483s" totalImagesPullingTime="389.039886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 22:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:33:34.898019337 +0000 UTC m=+2472.761705876" watchObservedRunningTime="2026-07-12 22:33:34.898314483 +0000 UTC m=+2472.762000997"
Jul 12 22:33:37.628602 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:37.628563    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:38.901294 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:38.901259    2581 generic.go:356] "Generic (PLEG): container finished" podID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerID="683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267" exitCode=0
Jul 12 22:33:38.901728 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:38.901335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" event={"ID":"2e95dac7-2ca0-484a-8f21-a833ff1c4864","Type":"ContainerDied","Data":"683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267"}
Jul 12 22:33:38.901774 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:38.901734    2581 scope.go:117] "RemoveContainer" containerID="683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267"
Jul 12 22:33:38.902752 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:38.902726    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:33:38.902831 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:38.902812    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:33:38.902883 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:38.902868    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 12 22:33:39.819574 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:39.819538    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:39.908255 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:39.908222    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" event={"ID":"2e95dac7-2ca0-484a-8f21-a833ff1c4864","Type":"ContainerStarted","Data":"47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7"}
Jul 12 22:33:40.022185 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:40.022147    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:40.023260 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:40.023235    2581 patch_prober.go:28] interesting pod/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 12 22:33:40.023387 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:40.023286    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 12 22:33:41.022809 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:41.022775    2581 patch_prober.go:28] interesting pod/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 12 22:33:41.023194 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:41.022828    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 12 22:33:41.788596 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:41.788560    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:41.889358 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:41.889329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:41.896060 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:41.896037    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:33:42.022206 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:42.022170    2581 patch_prober.go:28] interesting pod/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 12 22:33:42.022373 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:42.022230    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 12 22:33:43.022650 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:43.022607    2581 patch_prober.go:28] interesting pod/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 12 22:33:43.023076 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:43.022690    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 12 22:33:44.026658 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:44.026623    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:44.027059 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:44.026904    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:44.027521 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:44.027502    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:33:44.931281 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:44.931248    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:33:46.300263 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:46.300207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:46.398659 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:46.398581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:54.491214 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:54.491160    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:33:54.591997 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:33:54.591947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:34:11.368601 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:34:11.368559    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:34:15.237826 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:34:15.237735    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:34:47.257902 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:34:47.257859    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:34:50.328330 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:34:50.328298    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:34:54.440868 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:34:54.440817    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:34:58.721161 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:34:58.721130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:35:28.139864 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:35:28.139834    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:35:46.344554 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:35:46.344471    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:35:48.444573 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:35:48.444539    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:35:48.500192 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:35:48.500161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:36:02.841852 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:36:02.841812    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:36:22.780495 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:36:22.780458    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:36:22.877270 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:36:22.877239    2581 scope.go:117] "RemoveContainer" containerID="3c8a2fec5ab3a5b6bd9efa3e7e53ba1b54c592f26ac919c82d50a4ca16cea0de"
Jul 12 22:36:40.760771 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:36:40.760731    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:37:00.042715 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:00.042669    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:37:12.892981 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:12.892930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:37:12.993573 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:12.993534    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:37:15.555298 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:15.555201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:37:16.450715 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:16.450668    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:37:19.641772 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:19.641739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:37:20.652453 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:20.652420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:37:20.709337 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:20.709297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:37:22.760575 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:22.760536    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:37:22.763361 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:22.763339    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zwgn8_521ee44d-7557-4a46-90be-5574d731b913/ovn-acl-logging/0.log"
Jul 12 22:37:30.661988 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:30.661952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:37:35.733861 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:37:35.733831    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:38:10.564051 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:38:10.564017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:38:14.840986 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:38:14.840950    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:38:36.844262 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:38:36.844213    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:38:47.013924 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:38:47.013832    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:38:47.115856 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:38:47.115820    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:38:53.835835 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:38:53.835776    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:38:55.333605 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:38:55.333562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:38:55.435080 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:38:55.435027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:38:58.041683 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:38:58.041647    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:39:02.878512 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:39:02.878452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:39:03.986299 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:39:03.986260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:39:06.977918 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:39:06.977867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:39:07.940051 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:39:07.940001    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:39:08.041784 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:39:08.041751    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:39:17.742383 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:39:17.742347    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:39:31.264171 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:39:31.264136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:39:37.933906 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:39:37.933869    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:39:53.842001 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:39:53.841966    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:40:10.933129 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:10.933094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:40:18.835541 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:18.835444    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:40:20.167115 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:20.167064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:40:25.932387 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:25.932348    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:40:32.675772 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:32.675739    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:40:39.417396 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:39.417358    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:40:39.524267 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:39.524235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:40:49.425681 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.425639    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"]
Jul 12 22:40:49.426312 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.425923    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d" podUID="8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca" containerName="maas-api" containerID="cri-o://fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f" gracePeriod=30
Jul 12 22:40:49.450616 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.450591    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:40:49.676990 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.676928    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:40:49.851181 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.851148    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-openshift-service-ca\") pod \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") "
Jul 12 22:40:49.851359 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.851231    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-maas-api-tls\") pod \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") "
Jul 12 22:40:49.851359 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.851298    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tsvr\" (UniqueName: \"kubernetes.io/projected/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-kube-api-access-8tsvr\") pod \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\" (UID: \"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca\") "
Jul 12 22:40:49.851516 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.851492    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca" (UID: "8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:40:49.853277 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.853246    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-kube-api-access-8tsvr" (OuterVolumeSpecName: "kube-api-access-8tsvr") pod "8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca" (UID: "8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca"). InnerVolumeSpecName "kube-api-access-8tsvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:40:49.853387 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.853283    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca" (UID: "8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:40:49.952240 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.952140    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tsvr\" (UniqueName: \"kubernetes.io/projected/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-kube-api-access-8tsvr\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:40:49.952240 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.952184    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-openshift-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:40:49.952240 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:49.952196    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca-maas-api-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:40:50.068958 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:50.068924    2581 generic.go:356] "Generic (PLEG): container finished" podID="8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca" containerID="fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f" exitCode=0
Jul 12 22:40:50.069149 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:50.068967    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"
Jul 12 22:40:50.069149 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:50.069013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d" event={"ID":"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca","Type":"ContainerDied","Data":"fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f"}
Jul 12 22:40:50.069149 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:50.069067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d" event={"ID":"8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca","Type":"ContainerDied","Data":"ffef0d89b9e588868ab2fc884825eb8792986090ca26a46073f026f5b0757f4b"}
Jul 12 22:40:50.069149 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:50.069089    2581 scope.go:117] "RemoveContainer" containerID="fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f"
Jul 12 22:40:50.078318 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:50.078300    2581 scope.go:117] "RemoveContainer" containerID="fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f"
Jul 12 22:40:50.078536 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:40:50.078522    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f\": container with ID starting with fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f not found: ID does not exist" containerID="fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f"
Jul 12 22:40:50.078584 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:50.078543    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f"} err="failed to get container status \"fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f\": rpc error: code = NotFound desc = could not find container \"fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f\": container with ID starting with fb28352d313c974cc0037ac9bfab873525c66f411e601204b61a39e0d534d20f not found: ID does not exist"
Jul 12 22:40:50.091389 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:50.091364    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"]
Jul 12 22:40:50.095074 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:50.095053    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-66fe58-75d586c97f-cpf2d"]
Jul 12 22:40:50.668827 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:50.668791    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca" path="/var/lib/kubelet/pods/8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca/volumes"
Jul 12 22:40:52.739051 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:52.739011    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:40:54.006084 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:40:54.006036    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:00.138341 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:00.138288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:00.200687 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:00.200644    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:04.649261 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:04.649212    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"]
Jul 12 22:41:04.649752 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:04.649561    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy" containerID="cri-o://47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7" gracePeriod=30
Jul 12 22:41:04.659314 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:04.659283    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:04.887348 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:04.887316    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:05.491154 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:05.491117    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:05.589255 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:05.589220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:09.896245 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.896218    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:41:09.920922 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.920852    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-envoy\") pod \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") "
Jul 12 22:41:09.920922 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.920902    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-data\") pod \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") "
Jul 12 22:41:09.921127 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.920948    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-podinfo\") pod \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") "
Jul 12 22:41:09.921127 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.920997    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-socket\") pod \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") "
Jul 12 22:41:09.921127 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921017    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-certs\") pod \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") "
Jul 12 22:41:09.921127 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921061    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-token\") pod \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") "
Jul 12 22:41:09.923009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921297    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e95dac7-2ca0-484a-8f21-a833ff1c4864" (UID: "2e95dac7-2ca0-484a-8f21-a833ff1c4864"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:41:09.923009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921344    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e95dac7-2ca0-484a-8f21-a833ff1c4864" (UID: "2e95dac7-2ca0-484a-8f21-a833ff1c4864"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:41:09.923009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921405    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istiod-ca-cert\") pod \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") "
Jul 12 22:41:09.923009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921451    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-credential-socket\") pod \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") "
Jul 12 22:41:09.923009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921538    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25jr5\" (UniqueName: \"kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-kube-api-access-25jr5\") pod \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\" (UID: \"2e95dac7-2ca0-484a-8f21-a833ff1c4864\") "
Jul 12 22:41:09.923009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921755    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e95dac7-2ca0-484a-8f21-a833ff1c4864" (UID: "2e95dac7-2ca0-484a-8f21-a833ff1c4864"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:41:09.923009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921882    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-socket\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:09.923009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921901    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-workload-certs\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:09.923009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921917    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istiod-ca-cert\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:09.923009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921959    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e95dac7-2ca0-484a-8f21-a833ff1c4864" (UID: "2e95dac7-2ca0-484a-8f21-a833ff1c4864"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:41:09.923009 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.921994    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e95dac7-2ca0-484a-8f21-a833ff1c4864" (UID: "2e95dac7-2ca0-484a-8f21-a833ff1c4864"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:41:09.923619 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.923581    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e95dac7-2ca0-484a-8f21-a833ff1c4864" (UID: "2e95dac7-2ca0-484a-8f21-a833ff1c4864"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 12 22:41:09.923619 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.923591    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e95dac7-2ca0-484a-8f21-a833ff1c4864" (UID: "2e95dac7-2ca0-484a-8f21-a833ff1c4864"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 12 22:41:09.923749 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.923653    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e95dac7-2ca0-484a-8f21-a833ff1c4864" (UID: "2e95dac7-2ca0-484a-8f21-a833ff1c4864"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:41:09.924081 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:09.924063    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-kube-api-access-25jr5" (OuterVolumeSpecName: "kube-api-access-25jr5") pod "2e95dac7-2ca0-484a-8f21-a833ff1c4864" (UID: "2e95dac7-2ca0-484a-8f21-a833ff1c4864"). InnerVolumeSpecName "kube-api-access-25jr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:41:10.022594 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.022561    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-token\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:10.022594 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.022590    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-credential-socket\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:10.022594 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.022600    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25jr5\" (UniqueName: \"kubernetes.io/projected/2e95dac7-2ca0-484a-8f21-a833ff1c4864-kube-api-access-25jr5\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:10.022859 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.022610    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-envoy\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:10.022859 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.022618    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-data\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:10.022859 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.022627    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e95dac7-2ca0-484a-8f21-a833ff1c4864-istio-podinfo\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:10.172890 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.172802    2581 generic.go:356] "Generic (PLEG): container finished" podID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerID="47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7" exitCode=0
Jul 12 22:41:10.172890 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.172854    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"
Jul 12 22:41:10.173127 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.172888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" event={"ID":"2e95dac7-2ca0-484a-8f21-a833ff1c4864","Type":"ContainerDied","Data":"47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7"}
Jul 12 22:41:10.173127 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.172947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q" event={"ID":"2e95dac7-2ca0-484a-8f21-a833ff1c4864","Type":"ContainerDied","Data":"24bbf447aa20310c9210b061922360ee5541a83fe0e5f14ee240e3fada08e293"}
Jul 12 22:41:10.173127 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.172978    2581 scope.go:117] "RemoveContainer" containerID="47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7"
Jul 12 22:41:10.182131 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.182112    2581 scope.go:117] "RemoveContainer" containerID="683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267"
Jul 12 22:41:10.189910 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.189893    2581 scope.go:117] "RemoveContainer" containerID="47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7"
Jul 12 22:41:10.190187 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:41:10.190171    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7\": container with ID starting with 47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7 not found: ID does not exist" containerID="47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7"
Jul 12 22:41:10.190230 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.190195    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7"} err="failed to get container status \"47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7\": rpc error: code = NotFound desc = could not find container \"47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7\": container with ID starting with 47493dcc1c7fb6d17e5ee11fd0584dfad8384c08030ef41a0d048f89ac0902b7 not found: ID does not exist"
Jul 12 22:41:10.190230 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.190213    2581 scope.go:117] "RemoveContainer" containerID="683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267"
Jul 12 22:41:10.190453 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:41:10.190433    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267\": container with ID starting with 683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267 not found: ID does not exist" containerID="683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267"
Jul 12 22:41:10.190499 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.190459    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267"} err="failed to get container status \"683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267\": rpc error: code = NotFound desc = could not find container \"683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267\": container with ID starting with 683b9cd8e8fa38c2a308c43cc6558610af18659f7a91569e16e24861e8a22267 not found: ID does not exist"
Jul 12 22:41:10.195144 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.195118    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"]
Jul 12 22:41:10.198537 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.198515    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-66fe58-openshift-default-85b494bc4c-r4b7q"]
Jul 12 22:41:10.668955 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:10.668923    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" path="/var/lib/kubelet/pods/2e95dac7-2ca0-484a-8f21-a833ff1c4864/volumes"
Jul 12 22:41:15.523359 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:15.523320    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"]
Jul 12 22:41:15.523872 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:15.523561    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx" podUID="cef137e0-538d-4803-a961-35aba5d94d29" containerName="maas-api" containerID="cri-o://9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750" gracePeriod=30
Jul 12 22:41:15.550034 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:15.549999    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:15.980436 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:15.980414    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:41:16.076067 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.075972    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzmdr\" (UniqueName: \"kubernetes.io/projected/cef137e0-538d-4803-a961-35aba5d94d29-kube-api-access-vzmdr\") pod \"cef137e0-538d-4803-a961-35aba5d94d29\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") "
Jul 12 22:41:16.076067 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.076057    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef137e0-538d-4803-a961-35aba5d94d29-maas-api-tls\") pod \"cef137e0-538d-4803-a961-35aba5d94d29\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") "
Jul 12 22:41:16.076285 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.076092    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef137e0-538d-4803-a961-35aba5d94d29-openshift-service-ca\") pod \"cef137e0-538d-4803-a961-35aba5d94d29\" (UID: \"cef137e0-538d-4803-a961-35aba5d94d29\") "
Jul 12 22:41:16.076508 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.076479    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cef137e0-538d-4803-a961-35aba5d94d29-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cef137e0-538d-4803-a961-35aba5d94d29" (UID: "cef137e0-538d-4803-a961-35aba5d94d29"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 12 22:41:16.078088 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.078063    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cef137e0-538d-4803-a961-35aba5d94d29-kube-api-access-vzmdr" (OuterVolumeSpecName: "kube-api-access-vzmdr") pod "cef137e0-538d-4803-a961-35aba5d94d29" (UID: "cef137e0-538d-4803-a961-35aba5d94d29"). InnerVolumeSpecName "kube-api-access-vzmdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 12 22:41:16.078181 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.078112    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef137e0-538d-4803-a961-35aba5d94d29-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cef137e0-538d-4803-a961-35aba5d94d29" (UID: "cef137e0-538d-4803-a961-35aba5d94d29"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 12 22:41:16.177719 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.177672    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef137e0-538d-4803-a961-35aba5d94d29-maas-api-tls\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:16.177719 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.177726    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef137e0-538d-4803-a961-35aba5d94d29-openshift-service-ca\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:16.177914 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.177736    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzmdr\" (UniqueName: \"kubernetes.io/projected/cef137e0-538d-4803-a961-35aba5d94d29-kube-api-access-vzmdr\") on node \"ip-10-0-143-64.ec2.internal\" DevicePath \"\""
Jul 12 22:41:16.203949 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.203915    2581 generic.go:356] "Generic (PLEG): container finished" podID="cef137e0-538d-4803-a961-35aba5d94d29" containerID="9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750" exitCode=0
Jul 12 22:41:16.204104 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.203973    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"
Jul 12 22:41:16.204104 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.204006    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx" event={"ID":"cef137e0-538d-4803-a961-35aba5d94d29","Type":"ContainerDied","Data":"9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750"}
Jul 12 22:41:16.204104 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.204061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx" event={"ID":"cef137e0-538d-4803-a961-35aba5d94d29","Type":"ContainerDied","Data":"f9e187a3cf0ad02dda37b841dd7605aba854a2f4115828560d066230e9e76705"}
Jul 12 22:41:16.204104 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.204084    2581 scope.go:117] "RemoveContainer" containerID="9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750"
Jul 12 22:41:16.220484 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.220458    2581 scope.go:117] "RemoveContainer" containerID="9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750"
Jul 12 22:41:16.220905 ip-10-0-143-64 kubenswrapper[2581]: E0712 22:41:16.220884    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750\": container with ID starting with 9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750 not found: ID does not exist" containerID="9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750"
Jul 12 22:41:16.220999 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.220913    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750"} err="failed to get container status \"9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750\": rpc error: code = NotFound desc = could not find container \"9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750\": container with ID starting with 9c78dd3513f4d5b6b31722ff14f3f30b7b5494002b0019e118da2a02bd746750 not found: ID does not exist"
Jul 12 22:41:16.230318 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.230293    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"]
Jul 12 22:41:16.234095 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.234072    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7a7f11-77c66f558c-pgvzx"]
Jul 12 22:41:16.669240 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:16.669210    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cef137e0-538d-4803-a961-35aba5d94d29" path="/var/lib/kubelet/pods/cef137e0-538d-4803-a961-35aba5d94d29/volumes"
Jul 12 22:41:18.744938 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:18.744900    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-znt9w"]
Jul 12 22:41:20.095605 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:20.095553    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:26.152011 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:26.151960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:26.215581 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:26.215545    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:30.747284 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:30.747247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:30.955987 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:30.955939    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:36.808296 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:36.808262    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d867dd548-ms6pz_f28e5a47-6d5d-4e11-8f22-2f847413aa02/manager/0.log"
Jul 12 22:41:36.819899 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:36.819874    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d867dd548-ms6pz_f28e5a47-6d5d-4e11-8f22-2f847413aa02/copy-manifests/0.log"
Jul 12 22:41:37.417450 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:37.417411    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29731575-6bfgt_17596c7a-e53c-46f7-912f-b52893bd3476/cleanup/0.log"
Jul 12 22:41:37.527444 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:37.527408    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29731590-p4b96_23afd62c-10f3-4e55-8139-44bea2dda45b/cleanup/0.log"
Jul 12 22:41:37.634457 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:37.634432    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-5249e6ec-28dgq_024411b5-3a6a-4fcf-852a-42ce06a025ca/revoke-keys/0.log"
Jul 12 22:41:37.738908 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:37.738832    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-92b395e7-jvcjp_0e10fe9a-a139-47c9-952c-2ae0c1bf2642/revoke-keys/0.log"
Jul 12 22:41:37.960542 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:37.960512    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-7dcad0-6mvrn_9b972a04-d615-4d5b-835c-504fc50f218d/revoke-keys/0.log"
Jul 12 22:41:38.065973 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:38.065901    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-6cea543a-xhvjg_bf402a23-acdb-466b-a066-4e2663a7a0f5/revoke-keys/0.log"
Jul 12 22:41:38.172381 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:38.172353    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-65f13b-45zrg_8397948f-b6fd-4371-8e8f-e66378f80767/revoke-keys/0.log"
Jul 12 22:41:38.277267 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:38.277237    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-6976fc-797cx_c4cc2e98-b9b3-4150-b0a7-5357103ed232/revoke-keys/0.log"
Jul 12 22:41:38.383462 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:38.383435    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-dccf31a6-bz9hl_d7d9d70a-7d7e-40ff-8a6b-d8ba602338bd/revoke-keys/0.log"
Jul 12 22:41:38.492383 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:38.492356    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-3283879f-hg2qz_f960f3cf-bb38-4111-a680-5a9f0711d850/revoke-keys/0.log"
Jul 12 22:41:38.603405 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:38.603381    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-d3e48a9a-sfrdw_9db388e8-0214-4118-ad73-7d154bb2009f/revoke-keys/0.log"
Jul 12 22:41:40.860487 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:40.860457    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-znt9w_b21ed288-9b43-4f81-8fec-832f74a011f6/limitador/0.log"
Jul 12 22:41:41.436285 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:41.436254    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bfw4f_f08b9e69-3012-46f2-aef7-ed55612e91be/discovery/0.log"
Jul 12 22:41:42.126110 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:42.126066    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bdd8f84-25kc7_ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542/router/0.log"
Jul 12 22:41:42.912687 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:42.912658    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zr9hj_31b68f86-75bb-4f6d-910a-2b830e54d7ce/main/0.log"
Jul 12 22:41:47.323368 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:47.323290    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:47.421798 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:47.421764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:41:50.008438 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:50.008409    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9z5k9_7c5451bb-36cd-45ae-ae95-e7f841df4914/global-pull-secret-syncer/0.log"
Jul 12 22:41:50.091489 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:50.091457    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log"
Jul 12 22:41:50.230100 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:50.230042    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-64.ec2.internal_59a0a931653a6c997ccb77f8eb321696/haproxy/0.log"
Jul 12 22:41:56.534514 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:56.534484    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-znt9w_b21ed288-9b43-4f81-8fec-832f74a011f6/limitador/0.log"
Jul 12 22:41:58.481077 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.481046    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lpwfb_820b3430-6f46-4561-a1b7-971cc46f68c5/cluster-monitoring-operator/0.log"
Jul 12 22:41:58.504969 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.504943    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-vfn5g_d9220b34-86e7-47d5-a442-18b147045dc1/kube-state-metrics/0.log"
Jul 12 22:41:58.522002 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.521978    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-vfn5g_d9220b34-86e7-47d5-a442-18b147045dc1/kube-rbac-proxy-main/0.log"
Jul 12 22:41:58.541044 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.541020    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-vfn5g_d9220b34-86e7-47d5-a442-18b147045dc1/kube-rbac-proxy-self/0.log"
Jul 12 22:41:58.590577 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.590546    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-cdb4l_a9592871-98d5-46d3-8135-7c78e2165a9e/monitoring-plugin/0.log"
Jul 12 22:41:58.751047 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.750955    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tfs7q_1dad4548-a102-457d-884d-b394a672b5ec/node-exporter/0.log"
Jul 12 22:41:58.770974 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.770938    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tfs7q_1dad4548-a102-457d-884d-b394a672b5ec/kube-rbac-proxy/0.log"
Jul 12 22:41:58.789326 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.789301    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tfs7q_1dad4548-a102-457d-884d-b394a672b5ec/init-textfile/0.log"
Jul 12 22:41:58.813999 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.813972    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qxmt4_93e32902-212e-447d-939a-2ae30c8f370c/kube-rbac-proxy-main/0.log"
Jul 12 22:41:58.832997 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.832967    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qxmt4_93e32902-212e-447d-939a-2ae30c8f370c/kube-rbac-proxy-self/0.log"
Jul 12 22:41:58.851466 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.851442    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qxmt4_93e32902-212e-447d-939a-2ae30c8f370c/openshift-state-metrics/0.log"
Jul 12 22:41:58.887978 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.887952    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61c9e335-1e1a-4707-b32a-d7c8a71559b3/prometheus/0.log"
Jul 12 22:41:58.916378 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.916350    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61c9e335-1e1a-4707-b32a-d7c8a71559b3/config-reloader/0.log"
Jul 12 22:41:58.936899 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.936877    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61c9e335-1e1a-4707-b32a-d7c8a71559b3/thanos-sidecar/0.log"
Jul 12 22:41:58.957557 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.957524    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61c9e335-1e1a-4707-b32a-d7c8a71559b3/kube-rbac-proxy-web/0.log"
Jul 12 22:41:58.975289 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.975269    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61c9e335-1e1a-4707-b32a-d7c8a71559b3/kube-rbac-proxy/0.log"
Jul 12 22:41:58.993443 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:58.993422    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61c9e335-1e1a-4707-b32a-d7c8a71559b3/kube-rbac-proxy-thanos/0.log"
Jul 12 22:41:59.017544 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.017476    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_61c9e335-1e1a-4707-b32a-d7c8a71559b3/init-config-reloader/0.log"
Jul 12 22:41:59.897322 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897249    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"]
Jul 12 22:41:59.897820 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897738    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef137e0-538d-4803-a961-35aba5d94d29" containerName="maas-api"
Jul 12 22:41:59.897820 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897755    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef137e0-538d-4803-a961-35aba5d94d29" containerName="maas-api"
Jul 12 22:41:59.897820 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897769    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca" containerName="maas-api"
Jul 12 22:41:59.897820 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897774    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca" containerName="maas-api"
Jul 12 22:41:59.897820 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897782    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy"
Jul 12 22:41:59.897820 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897788    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy"
Jul 12 22:41:59.897820 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897805    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy"
Jul 12 22:41:59.897820 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897810    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy"
Jul 12 22:41:59.898069 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897867    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eebac9a-c0fa-4f4d-a2ab-47616ab4c8ca" containerName="maas-api"
Jul 12 22:41:59.898069 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897878    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cef137e0-538d-4803-a961-35aba5d94d29" containerName="maas-api"
Jul 12 22:41:59.898069 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897886    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy"
Jul 12 22:41:59.898069 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.897891    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e95dac7-2ca0-484a-8f21-a833ff1c4864" containerName="istio-proxy"
Jul 12 22:41:59.901135 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.901119    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:41:59.903652 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.903630    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-grwlh\"/\"openshift-service-ca.crt\""
Jul 12 22:41:59.904691 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.904675    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-grwlh\"/\"kube-root-ca.crt\""
Jul 12 22:41:59.904819 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.904679    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-grwlh\"/\"default-dockercfg-zbdsv\""
Jul 12 22:41:59.909411 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.909384    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"]
Jul 12 22:41:59.974362 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.974322    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-sys\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:41:59.974362 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.974370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-proc\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:41:59.974637 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.974387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-podres\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:41:59.974637 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.974456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-lib-modules\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:41:59.974637 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:41:59.974501    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr2rp\" (UniqueName: \"kubernetes.io/projected/4d0c098f-e0be-494e-8262-7e715e8241b5-kube-api-access-nr2rp\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.075978 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.075933    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-sys\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.075978 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.075986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-proc\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.076199 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.076062    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-sys\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.076199 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.076105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-podres\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.076199 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.076116    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-proc\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.076199 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.076139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-lib-modules\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.076199 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.076159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr2rp\" (UniqueName: \"kubernetes.io/projected/4d0c098f-e0be-494e-8262-7e715e8241b5-kube-api-access-nr2rp\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.076390 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.076230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-podres\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.076390 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.076256    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d0c098f-e0be-494e-8262-7e715e8241b5-lib-modules\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.084184 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.084150    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr2rp\" (UniqueName: \"kubernetes.io/projected/4d0c098f-e0be-494e-8262-7e715e8241b5-kube-api-access-nr2rp\") pod \"perf-node-gather-daemonset-d84p2\" (UID: \"4d0c098f-e0be-494e-8262-7e715e8241b5\") " pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.212409 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.212304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:00.345435 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.345411    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"]
Jul 12 22:42:00.347723 ip-10-0-143-64 kubenswrapper[2581]: W0712 22:42:00.347672    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4d0c098f_e0be_494e_8262_7e715e8241b5.slice/crio-151046d9059fecede8a3aad5e284e9b2f619f3d39b81e42dbfb4a0784dc61eb2 WatchSource:0}: Error finding container 151046d9059fecede8a3aad5e284e9b2f619f3d39b81e42dbfb4a0784dc61eb2: Status 404 returned error can't find the container with id 151046d9059fecede8a3aad5e284e9b2f619f3d39b81e42dbfb4a0784dc61eb2
Jul 12 22:42:00.417423 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:00.417382    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2" event={"ID":"4d0c098f-e0be-494e-8262-7e715e8241b5","Type":"ContainerStarted","Data":"151046d9059fecede8a3aad5e284e9b2f619f3d39b81e42dbfb4a0784dc61eb2"}
Jul 12 22:42:01.423640 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:01.423605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2" event={"ID":"4d0c098f-e0be-494e-8262-7e715e8241b5","Type":"ContainerStarted","Data":"5f970fe1243c70835d36a17fe3ae7a13336aef5043cbc9af4e9b89561407e146"}
Jul 12 22:42:01.424087 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:01.423689    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:01.439304 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:01.439250    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2" podStartSLOduration=2.43923267 podStartE2EDuration="2.43923267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 22:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 22:42:01.43859242 +0000 UTC m=+2979.302278932" watchObservedRunningTime="2026-07-12 22:42:01.43923267 +0000 UTC m=+2979.302919183"
Jul 12 22:42:03.120285 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:03.120254    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7b7nt_35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef/dns/0.log"
Jul 12 22:42:03.160654 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:03.160626    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7b7nt_35c464fc-1ba7-4f96-9cb2-67c2c62fb0ef/kube-rbac-proxy/0.log"
Jul 12 22:42:03.286430 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:03.286403    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f5c5g_9e22ccf9-a301-4b5a-af20-621e9027b3be/dns-node-resolver/0.log"
Jul 12 22:42:03.575839 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:03.575745    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:42:03.631193 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:03.631146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:42:03.926327 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:03.926299    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ns7fs_2ccdf2e0-1700-429b-8198-0861386af90b/node-ca/0.log"
Jul 12 22:42:04.956614 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:04.956578    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bfw4f_f08b9e69-3012-46f2-aef7-ed55612e91be/discovery/0.log"
Jul 12 22:42:05.188827 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:05.188797    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bdd8f84-25kc7_ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542/router/0.log"
Jul 12 22:42:05.944836 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:05.944809    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rn82d_08433406-21df-4003-8a8e-7aae7c0d5632/serve-healthcheck-canary/0.log"
Jul 12 22:42:06.417999 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:06.417966    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-r5hhr_41ad5c1e-6fc9-41ca-bddb-df1c0199d59f/insights-operator/0.log"
Jul 12 22:42:06.418543 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:06.418528    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-r5hhr_41ad5c1e-6fc9-41ca-bddb-df1c0199d59f/insights-operator/1.log"
Jul 12 22:42:06.509666 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:06.509637    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9mv56_5e6cc8ab-ffd4-4203-91e1-366c8592552a/kube-rbac-proxy/0.log"
Jul 12 22:42:06.530204 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:06.530181    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9mv56_5e6cc8ab-ffd4-4203-91e1-366c8592552a/exporter/0.log"
Jul 12 22:42:06.552398 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:06.552370    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9mv56_5e6cc8ab-ffd4-4203-91e1-366c8592552a/extractor/0.log"
Jul 12 22:42:07.438051 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:07.438022    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-grwlh/perf-node-gather-daemonset-d84p2"
Jul 12 22:42:09.529555 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:09.529522    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d867dd548-ms6pz_f28e5a47-6d5d-4e11-8f22-2f847413aa02/manager/0.log"
Jul 12 22:42:09.547603 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:09.547569    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d867dd548-ms6pz_f28e5a47-6d5d-4e11-8f22-2f847413aa02/copy-manifests/0.log"
Jul 12 22:42:10.790812 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:10.790779    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bfw4f_f08b9e69-3012-46f2-aef7-ed55612e91be/discovery/0.log"
Jul 12 22:42:10.819915 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:10.819891    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-db9cf56f-s44gh_5ad0dfd5-1b0c-4153-9ddc-a85f2f06e9b8/manager/0.log"
Jul 12 22:42:11.014645 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:11.014564    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bdd8f84-25kc7_ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542/router/0.log"
Jul 12 22:42:12.366064 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:12.366035    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bfw4f_f08b9e69-3012-46f2-aef7-ed55612e91be/discovery/0.log"
Jul 12 22:42:12.550031 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:12.550004    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bdd8f84-25kc7_ff4bd308-4ce9-4f1e-bdb1-47e8a77fb542/router/0.log"
Jul 12 22:42:13.627757 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:13.627722    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:42:13.728325 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:13.728287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dnzkt_7769fe0a-f440-4ac6-866c-8c379f4cf6f6/konnectivity-agent/0.log" limit=1024
Jul 12 22:42:17.248241 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:17.248209    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mc2jt_170cc23c-d32d-44c6-be5b-e8d4a9b175ea/kube-multus-additional-cni-plugins/0.log"
Jul 12 22:42:17.268192 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:17.268163    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mc2jt_170cc23c-d32d-44c6-be5b-e8d4a9b175ea/egress-router-binary-copy/0.log"
Jul 12 22:42:17.290023 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:17.289995    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mc2jt_170cc23c-d32d-44c6-be5b-e8d4a9b175ea/cni-plugins/0.log"
Jul 12 22:42:17.309623 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:17.309595    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mc2jt_170cc23c-d32d-44c6-be5b-e8d4a9b175ea/bond-cni-plugin/0.log"
Jul 12 22:42:17.331594 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:17.331572    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mc2jt_170cc23c-d32d-44c6-be5b-e8d4a9b175ea/routeoverride-cni/0.log"
Jul 12 22:42:17.353306 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:17.353281    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mc2jt_170cc23c-d32d-44c6-be5b-e8d4a9b175ea/whereabouts-cni-bincopy/0.log"
Jul 12 22:42:17.375529 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:17.375502    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mc2jt_170cc23c-d32d-44c6-be5b-e8d4a9b175ea/whereabouts-cni/0.log"
Jul 12 22:42:17.575264 ip-10-0-143-64 kubenswrapper[2581]: I0712 22:42:17.575188    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b6ktm_08852625-0839-4870-9c4d-ca1810b955c4/kube-multus/0.log"