Jul 20 17:46:03.308062 ip-10-0-141-126 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 17:46:03.308077 ip-10-0-141-126 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 17:46:03.308086 ip-10-0-141-126 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 17:46:03.308419 ip-10-0-141-126 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 17:46:13.471672 ip-10-0-141-126 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 17:46:13.471688 ip-10-0-141-126 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e33f22b6cdc94ac69801bca481a940d4 --
Jul 20 17:48:11.044819 ip-10-0-141-126 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 17:48:11.434350 ip-10-0-141-126 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 17:48:11.434350 ip-10-0-141-126 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 17:48:11.434350 ip-10-0-141-126 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 17:48:11.434350 ip-10-0-141-126 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 17:48:11.434350 ip-10-0-141-126 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 17:48:11.435035 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.434412    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 17:48:11.440974 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.440947    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:48:11.440974 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.440968    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:48:11.440974 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.440974    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:48:11.440974 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.440979    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:48:11.440974 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.440983    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.440987    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.440991    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.440995    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.440999    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441003    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441007    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441010    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441014    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441018    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441021    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441025    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441029    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441033    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441038    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441042    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441045    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441049    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441052    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441056    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:48:11.441275 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441060    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441064    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441067    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441073    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441077    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441080    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441084    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441087    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441094    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441100    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441105    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441109    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441113    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441117    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441124    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441129    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441133    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441137    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441141    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441146    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:48:11.442094 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441150    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441154    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441158    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441163    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441167    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441171    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441176    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441181    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441185    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441189    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441193    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441198    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441202    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441206    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441210    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441214    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441219    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441224    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441228    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:48:11.443019 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441233    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441237    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441242    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441246    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441250    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441254    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441258    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441262    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441266    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441270    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441274    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441277    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441281    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441286    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441289    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441294    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441298    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441302    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441310    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:48:11.443836 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441316    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441321    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441326    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441330    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441333    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441337    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441341    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441346    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441352    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441357    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441362    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441366    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441371    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441376    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441381    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441385    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.441390    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442556    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442566    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:48:11.444630 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442570    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442575    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442579    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442583    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442588    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442592    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442596    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442600    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442604    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442609    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442613    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442618    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442622    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442629    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442635    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442641    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442646    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442650    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442654    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:48:11.445434 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442659    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442663    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442667    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442671    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442676    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442680    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442687    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442692    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442696    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442700    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442704    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442708    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442712    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442717    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442722    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442726    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442730    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442734    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442738    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442742    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:48:11.446007 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442746    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442750    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442756    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442761    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442765    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442771    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442774    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442779    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442783    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442788    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442792    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442797    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442800    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442804    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442808    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442812    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442816    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442820    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442827    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442831    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:48:11.446593 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442836    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442840    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442844    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442848    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442852    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442856    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442863    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442869    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442874    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442878    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442882    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442886    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442891    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442895    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442900    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442905    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442909    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442913    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442917    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:48:11.447213 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442924    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442928    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442932    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442937    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442941    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442945    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442949    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442954    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442958    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442962    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442966    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442973    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442978    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442982    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442987    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442991    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442995    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.442999    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443003    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443643    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:48:11.447887 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443652    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443657    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443661    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443665    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443669    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443673    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443677    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443682    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443687    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443692    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443696    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443700    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443704    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443708    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443713    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443718    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443722    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443726    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443730    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443734    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:48:11.448391 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443738    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443742    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443746    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443751    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443756    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443760    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443764    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443768    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443772    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443776    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443780    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443784    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443788    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443792    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443796    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443800    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443804    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443808    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443812    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443817    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:48:11.448966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443821    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443825    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443829    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443834    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443840    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443844    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443852    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443859    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443864    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443869    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443874    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443878    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443883    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443887    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443891    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443896    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443900    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443904    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443909    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:48:11.449476 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443913    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443918    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443922    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443926    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443930    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443934    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443938    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443943    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443947    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443951    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443955    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443959    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443964    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443968    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443972    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443976    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443980    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443984    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443988    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443992    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:48:11.449990 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.443996    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444001    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444006    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444010    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444014    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444018    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444022    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444035    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444044    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444048    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444053    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444058    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444062    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444067    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444071    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444076    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444081    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444085    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.444089    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444185    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 17:48:11.450477 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444196    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444204    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444211    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444217    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444222    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444228    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444235    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444240    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444244    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444249    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444254    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444260    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444264    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444269    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444274    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444279    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444284    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444291    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444296    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444301    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444309    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444314    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444320    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 17:48:11.451020 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444325    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444330    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444334    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444339    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444343    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444348    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444353    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444357    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444370    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444374    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444379    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444383    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444388    2562 flags.go:64] FLAG: --enable-server="true"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444392    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444398    2562 flags.go:64] FLAG: --event-burst="100"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444403    2562 flags.go:64] FLAG: --event-qps="50"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444407    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444412    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444417    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444422    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444427    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444434    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444440    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444444    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444449    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 17:48:11.451577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444454    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444459    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444463    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444468    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444474    2562 flags.go:64] FLAG: --feature-gates=""
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444480    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444485    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444490    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444495    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444499    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444504    2562 flags.go:64] FLAG: --help="false"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444509    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444514    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444540    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444544    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444550    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444555    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444560    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444564    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444569    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444573    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444578    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444584    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444588    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 20 17:48:11.452282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444593    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444597    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444603    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444607    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444614    2562 flags.go:64] FLAG: --lock-file=""
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444618    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444623    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444628    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444636    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444642    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444646    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444650    2562 flags.go:64] FLAG: --logging-format="text"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444656    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444661    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444666    2562 flags.go:64] FLAG: --manifest-url=""
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444670    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444677    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444681    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444687    2562 flags.go:64] FLAG: --max-pods="110"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444692    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444697    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444701    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444706    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444710    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444715    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 17:48:11.452903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444720    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444738    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444743    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444748    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444752    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444756    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444764    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444769    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444773    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444778    2562 flags.go:64] FLAG: --port="10250"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444783    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444787    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e334e1323af7302a"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444794    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444798    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444803    2562 flags.go:64] FLAG: --register-node="true"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444807    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444813    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444819    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444824    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444829    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444835    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444840    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444845    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444850    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444854    2562 flags.go:64] FLAG: --runonce="false"
Jul 20 17:48:11.453540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444859    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444864    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444868    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444873    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444877    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444882    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444887    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444892    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444896    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444900    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444905    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444909    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444914    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444919    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444923    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444932    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444937    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444941    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444948    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444954    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444959    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444964    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444968    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444973    2562 flags.go:64] FLAG: --v="2"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444979    2562 flags.go:64] FLAG: --version="false"
Jul 20 17:48:11.454132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444986    2562 flags.go:64] FLAG: --vmodule=""
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.444994    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.445004    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445183    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445189    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445194    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445199    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445203    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445208    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445212    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445216    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445220    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445225    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445229    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445233    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445237    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445241    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445246    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445250    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445254    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:48:11.454792 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445258    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445263    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445267    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445271    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445275    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445279    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445285    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445289    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445294    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445298    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445304    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445311    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445315    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445322    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445326    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445331    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445335    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445339    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445343    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445347    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:48:11.455279 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445351    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445355    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445359    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445364    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445368    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445372    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445376    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445380    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445384    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445388    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445392    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445396    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445400    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445405    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445409    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445413    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445417    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445421    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445426    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445431    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:48:11.455775 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445435    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445438    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445442    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445446    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445450    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445456    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445461    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445465    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445469    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445474    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445478    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445482    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445486    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445490    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445495    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445498    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445502    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445506    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445511    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445532    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:48:11.456247 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445537    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445541    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445545    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445552    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445558    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445563    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445567    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445572    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445577    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445581    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445587    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445591    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445595    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445600    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445604    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445610    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445617    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445623    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445628    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:48:11.456766 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445633    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445638    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.445642    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.446269    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.453497    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.453514    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.453546    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.453552    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453607    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453613    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453616    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453619    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453623    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453626    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:48:11.457215 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453629    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453632    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453634    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453638    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453642    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453645    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453648    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453651    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453654    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453657    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453660    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453662    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453665    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453668    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453671    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453674    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453676    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453679    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453681    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:48:11.457616 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453684    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453686    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453689    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453691    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453695    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453698    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453701    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453703    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453706    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453709    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453713    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453716    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453718    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453721    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453725    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453728    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453730    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453733    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453736    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:48:11.458069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453738    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453740    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453743    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453746    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453748    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453750    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453753    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453755    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453758    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453760    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453762    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453765    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453767    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453769    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453772    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453774    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453777    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453780    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453784    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453786    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:48:11.458535 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453789    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453791    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453794    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453796    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453799    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453801    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453803    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453806    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453808    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453810    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453813    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453815    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453818    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453820    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453823    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453825    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453828    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453830    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453833    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453835    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:48:11.459000 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453837    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453840    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453842    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453845    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453847    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453850    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453852    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453854    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453857    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453861    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453863    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453867    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453869    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453872    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.453874    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:48:11.459464 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.453879    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454006    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454011    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454014    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454017    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454019    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454022    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454025    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454028    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454032    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454035    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454038    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454040    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454043    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454046    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454050    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454053    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454055    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454058    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 17:48:11.459868 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454060    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454062    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454065    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454067    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454070    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454072    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454075    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454077    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454080    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454082    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454085    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454087    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454090    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454092    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454094    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454097    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454099    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454102    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454104    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 17:48:11.460314 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454107    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454109    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454111    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454114    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454116    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454118    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454121    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454123    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454125    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454128    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454130    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454132    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454135    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454137    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454140    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454142    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454145    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454148    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454150    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454152    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 17:48:11.460788 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454155    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454157    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454160    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454162    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454165    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454168    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454170    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454173    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454175    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454177    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454180    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454182    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454185    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454187    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454189    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454192    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454194    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454197    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454199    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454201    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 17:48:11.461295 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454203    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454206    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454208    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454211    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454213    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454215    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454218    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454220    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454222    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454225    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454227    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454230    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454232    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454235    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454237    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454240    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454243    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454247    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454249    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454252    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 17:48:11.461841 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454255    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 17:48:11.462312 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:11.454257    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 17:48:11.462312 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.454262    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 17:48:11.462312 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.454361    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 17:48:11.462312 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.456204    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 17:48:11.462312 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.457573    2562 server.go:1019] "Starting client certificate rotation"
Jul 20 17:48:11.462312 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.457668    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 17:48:11.462312 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.458269    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 17:48:11.462312 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.459754    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 17:48:11.462312 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.460903    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 17:48:11.472923 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.472906    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 20 17:48:11.474810 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.474794    2562 log.go:25] "Validated CRI v1 image API"
Jul 20 17:48:11.475621 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.475605    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 17:48:11.481918 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.481900    2562 fs.go:135] Filesystem UUIDs: map[783b2ffa-98b5-4e3d-a37b-fa87401eae30:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7e2bda1c-3c62-4193-abdb-7053be845d1c:/dev/nvme0n1p4]
Jul 20 17:48:11.481988 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.481918    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 17:48:11.488343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.488236    2562 manager.go:216] Machine: {Timestamp:2026-07-20 17:48:11.487004088 +0000 UTC m=+0.327469863 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3086935 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28a8bfa2e49c9d32469a5dc7903176 SystemUUID:ec28a8bf-a2e4-9c9d-3246-9a5dc7903176 BootID:e33f22b6-cdc9-4ac6-9801-bca481a940d4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0f:c5:f9:5b:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0f:c5:f9:5b:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:dd:04:77:2a:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 17:48:11.488343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.488340    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 17:48:11.488446 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.488412    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 17:48:11.491106 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.491083    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 17:48:11.491236 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.491108    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-126.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 17:48:11.491750 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.491741    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 17:48:11.491781 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.491753    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 17:48:11.491781 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.491760    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 17:48:11.492438 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.492428    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 17:48:11.493534 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.493512    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 17:48:11.496407 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.496396    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 17:48:11.496514 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.496505    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 17:48:11.497096 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.497085    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 17:48:11.497135 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.497099    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 17:48:11.497135 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.497112    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 17:48:11.497135 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.497121    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 20 17:48:11.497135 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.497129    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 17:48:11.497480 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.497466    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 17:48:11.497566 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.497492    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 17:48:11.501053 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.501027    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 17:48:11.503025 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.503012    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 17:48:11.503086 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.503041    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 17:48:11.504104 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504091    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 17:48:11.504154 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504111    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 17:48:11.504154 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504118    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 17:48:11.504154 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504128    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 17:48:11.504154 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504139    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 17:48:11.504154 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504145    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 17:48:11.504154 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504155    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 17:48:11.504329 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504164    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 17:48:11.504329 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504175    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 17:48:11.504329 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504183    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 17:48:11.504329 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504194    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 17:48:11.504329 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.504202    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 17:48:11.505075 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.505061    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 17:48:11.505125 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.505080    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 17:48:11.508343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.508320    2562 server.go:1268] "Started kubelet"
Jul 20 17:48:11.508421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.508391    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 17:48:11.508640 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.508479    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 17:48:11.508778 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.508761    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 17:48:11.509304 ip-10-0-141-126 systemd[1]: Started Kubernetes Kubelet.
Jul 20 17:48:11.512533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.512458    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 17:48:11.514835 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.514802    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 17:48:11.516216 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.516200    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 17:48:11.520564 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.520548    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 17:48:11.520647 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.520568    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 17:48:11.520713 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.520692    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:11.521432 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.521415    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 17:48:11.521432 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.521435    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 17:48:11.521601 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.521420    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 17:48:11.521601 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.521589    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 17:48:11.521601 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.521599    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 17:48:11.521960 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.521945    2562 factory.go:153] Registering CRI-O factory
Jul 20 17:48:11.522000 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.521966    2562 factory.go:223] Registration of the crio container factory successfully
Jul 20 17:48:11.522033 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.522018    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 17:48:11.522033 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.522026    2562 factory.go:55] Registering systemd factory
Jul 20 17:48:11.522033 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.522032    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 20 17:48:11.522134 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.522052    2562 factory.go:103] Registering Raw factory
Jul 20 17:48:11.522134 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.522068    2562 manager.go:1196] Started watching for new ooms in manager
Jul 20 17:48:11.522566 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.522555    2562 manager.go:349] Starting recovery of all containers
Jul 20 17:48:11.532766 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.532740    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 17:48:11.532893 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.532873    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 17:48:11.533033 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.533020    2562 manager.go:354] Recovery completed
Jul 20 17:48:11.537178 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.537165    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:48:11.539376 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.539348    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:48:11.539455 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.539392    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:48:11.539455 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.539402    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:48:11.540026 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.540012    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:48:11.540114 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.540013    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 17:48:11.540114 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.540080    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 17:48:11.540114 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.540101    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 17:48:11.540792 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.540775    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:48:11.540858 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.540808    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:48:11.540858 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.540818    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:48:11.541504 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.541489    2562 policy_none.go:49] "None policy: Start"
Jul 20 17:48:11.541504 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.541504    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 17:48:11.541636 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.541535    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 17:48:11.542585 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.542574    2562 policy_none.go:47] "Start"
Jul 20 17:48:11.574766 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.574617    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 17:48:11.580101 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.580088    2562 manager.go:337] "Starting Device Plugin manager"
Jul 20 17:48:11.580157 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.580122    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 17:48:11.580157 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.580132    2562 server.go:87] "Starting device plugin registration server"
Jul 20 17:48:11.580421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.580397    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 17:48:11.580500 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.580420    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 17:48:11.580574 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.580513    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 17:48:11.580622 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.580608    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-126.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 17:48:11.580677 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.580664    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 17:48:11.580711 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.580674    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 17:48:11.580800 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.580740    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 17:48:11.580800 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.580749    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 17:48:11.581261 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.581235    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 17:48:11.581311 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.581285    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:11.581648 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.580547    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-126.ec2.internal.18c410adeb469292  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-126.ec2.internal,UID:ip-10-0-141-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-126.ec2.internal,},FirstTimestamp:2026-07-20 17:48:11.508216466 +0000 UTC m=+0.348682240,LastTimestamp:2026-07-20 17:48:11.508216466 +0000 UTC m=+0.348682240,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-126.ec2.internal,}"
Jul 20 17:48:11.585967 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.585903    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-126.ec2.internal.18c410aded220936  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-126.ec2.internal,UID:ip-10-0-141-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-126.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-126.ec2.internal,},FirstTimestamp:2026-07-20 17:48:11.539376438 +0000 UTC m=+0.379842211,LastTimestamp:2026-07-20 17:48:11.539376438 +0000 UTC m=+0.379842211,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-126.ec2.internal,}"
Jul 20 17:48:11.623190 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.623111    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-126.ec2.internal.18c410aded22594b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-126.ec2.internal,UID:ip-10-0-141-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-126.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-126.ec2.internal,},FirstTimestamp:2026-07-20 17:48:11.539396939 +0000 UTC m=+0.379862711,LastTimestamp:2026-07-20 17:48:11.539396939 +0000 UTC m=+0.379862711,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-126.ec2.internal,}"
Jul 20 17:48:11.638420 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.638339    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-126.ec2.internal.18c410aded228247  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-126.ec2.internal,UID:ip-10-0-141-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-126.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-126.ec2.internal,},FirstTimestamp:2026-07-20 17:48:11.539407431 +0000 UTC m=+0.379873205,LastTimestamp:2026-07-20 17:48:11.539407431 +0000 UTC m=+0.379873205,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-126.ec2.internal,}"
Jul 20 17:48:11.660018 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.659944    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-126.ec2.internal.18c410aded220936\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-126.ec2.internal.18c410aded220936  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-126.ec2.internal,UID:ip-10-0-141-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-126.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-126.ec2.internal,},FirstTimestamp:2026-07-20 17:48:11.539376438 +0000 UTC m=+0.379842211,LastTimestamp:2026-07-20 17:48:11.540790978 +0000 UTC m=+0.381256754,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-126.ec2.internal,}"
Jul 20 17:48:11.680578 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.680552    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:48:11.680809 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.680741    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-126.ec2.internal.18c410aded22594b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-126.ec2.internal.18c410aded22594b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-126.ec2.internal,UID:ip-10-0-141-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-126.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-126.ec2.internal,},FirstTimestamp:2026-07-20 17:48:11.539396939 +0000 UTC m=+0.379862711,LastTimestamp:2026-07-20 17:48:11.540813247 +0000 UTC m=+0.381279019,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-126.ec2.internal,}"
Jul 20 17:48:11.681498 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.681477    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:48:11.681593 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.681534    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:48:11.681593 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.681550    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:48:11.681593 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.681579    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.694429 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.694380    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x94bp"
Jul 20 17:48:11.695026 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.694965    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-126.ec2.internal.18c410aded228247\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-126.ec2.internal.18c410aded228247  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-126.ec2.internal,UID:ip-10-0-141-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-126.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-126.ec2.internal,},FirstTimestamp:2026-07-20 17:48:11.539407431 +0000 UTC m=+0.379873205,LastTimestamp:2026-07-20 17:48:11.54082222 +0000 UTC m=+0.381287993,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-126.ec2.internal,}"
Jul 20 17:48:11.703551 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.703496    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 17:48:11.704918 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.704898    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 17:48:11.705008 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.704932    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 17:48:11.705008 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.704954    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 17:48:11.705008 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.704990    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 17:48:11.707005 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.706985    2562 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-141-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.707209 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.707146    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-126.ec2.internal.18c410adefb5a8be  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-126.ec2.internal,UID:ip-10-0-141-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-141-126.ec2.internal,},FirstTimestamp:2026-07-20 17:48:11.582605502 +0000 UTC m=+0.423071261,LastTimestamp:2026-07-20 17:48:11.582605502 +0000 UTC m=+0.423071261,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-126.ec2.internal,}"
Jul 20 17:48:11.707258 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.707237    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 20 17:48:11.711421 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.711360    2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-126.ec2.internal.18c410aded220936\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-126.ec2.internal.18c410aded220936  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-126.ec2.internal,UID:ip-10-0-141-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-126.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-126.ec2.internal,},FirstTimestamp:2026-07-20 17:48:11.539376438 +0000 UTC m=+0.379842211,LastTimestamp:2026-07-20 17:48:11.681498757 +0000 UTC m=+0.521964538,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-126.ec2.internal,}"
Jul 20 17:48:11.715613 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.715595    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x94bp"
Jul 20 17:48:11.790456 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.790426    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-126.ec2.internal\" not found" node="ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.805571 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.805548    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-126.ec2.internal"]
Jul 20 17:48:11.805634 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.805615    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:48:11.807115 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.807102    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:48:11.807183 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.807137    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:48:11.807183 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.807155    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:48:11.808529 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.808504    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:48:11.808659 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.808643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.808699 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.808674    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:48:11.809256 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.809242    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:48:11.809326 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.809266    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:48:11.809326 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.809276    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:48:11.809326 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.809244    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:48:11.809458 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.809347    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:48:11.809458 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.809365    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:48:11.810213 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.810198    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.810279 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.810222    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:48:11.810906 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.810891    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:48:11.810962 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.810923    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:48:11.810962 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.810938    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:48:11.823116 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.823097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e2eefae3baccec91f5e5bfac1588b9a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-126.ec2.internal\" (UID: \"9e2eefae3baccec91f5e5bfac1588b9a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.823190 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.823121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b10c9a794a263c36b584cb10f4cb7998-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal\" (UID: \"b10c9a794a263c36b584cb10f4cb7998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.823190 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.823139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10c9a794a263c36b584cb10f4cb7998-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal\" (UID: \"b10c9a794a263c36b584cb10f4cb7998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.834108 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.834089    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-126.ec2.internal\" not found" node="ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.838572 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.838555    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-126.ec2.internal\" not found" node="ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.907615 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.907589    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:48:11.908542 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.908501    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:48:11.908660 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.908554    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:48:11.908660 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.908569    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:48:11.908660 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.908603    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.923469 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.923450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10c9a794a263c36b584cb10f4cb7998-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal\" (UID: \"b10c9a794a263c36b584cb10f4cb7998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.923590 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.923488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e2eefae3baccec91f5e5bfac1588b9a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-126.ec2.internal\" (UID: \"9e2eefae3baccec91f5e5bfac1588b9a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.923590 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.923548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b10c9a794a263c36b584cb10f4cb7998-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal\" (UID: \"b10c9a794a263c36b584cb10f4cb7998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.923590 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.923576    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b10c9a794a263c36b584cb10f4cb7998-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal\" (UID: \"b10c9a794a263c36b584cb10f4cb7998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.923714 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.923591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b10c9a794a263c36b584cb10f4cb7998-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal\" (UID: \"b10c9a794a263c36b584cb10f4cb7998\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.923714 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.923579    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e2eefae3baccec91f5e5bfac1588b9a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-126.ec2.internal\" (UID: \"9e2eefae3baccec91f5e5bfac1588b9a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.924406 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:11.924393    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-126.ec2.internal"
Jul 20 17:48:11.924438 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.924412    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-126.ec2.internal\": node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:11.963436 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:11.963376    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:12.064472 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:12.064442    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:12.136609 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.136572    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:12.141513 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.141497    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:12.165391 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:12.165359    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:12.265966 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:12.265876    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:12.366423 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:12.366381    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:12.456866 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.456840    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 17:48:12.467124 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:12.467102    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:12.563048 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.562806    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 17:48:12.564148 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.564130    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 17:48:12.564233 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.564162    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 17:48:12.564233 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.564172    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeHasSufficientPID"
Jul 20 17:48:12.567772 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:12.567754    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:12.594367 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.594343    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 17:48:12.620545 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:12.619494    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2eefae3baccec91f5e5bfac1588b9a.slice/crio-68633a6449ee051499b088e5593d13eca08c912394e1ec1d80a7ed1a3013a5c7 WatchSource:0}: Error finding container 68633a6449ee051499b088e5593d13eca08c912394e1ec1d80a7ed1a3013a5c7: Status 404 returned error can't find the container with id 68633a6449ee051499b088e5593d13eca08c912394e1ec1d80a7ed1a3013a5c7
Jul 20 17:48:12.620545 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:12.619962    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10c9a794a263c36b584cb10f4cb7998.slice/crio-2b2fec86c68c535e9c04c33c4a58f6b224d99ee933387d6772ae3aefd765631c WatchSource:0}: Error finding container 2b2fec86c68c535e9c04c33c4a58f6b224d99ee933387d6772ae3aefd765631c: Status 404 returned error can't find the container with id 2b2fec86c68c535e9c04c33c4a58f6b224d99ee933387d6772ae3aefd765631c
Jul 20 17:48:12.625220 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.625205    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 17:48:12.668464 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:12.668437    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:12.688320 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.688300    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 17:48:12.708508 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.708459    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-126.ec2.internal" event={"ID":"9e2eefae3baccec91f5e5bfac1588b9a","Type":"ContainerStarted","Data":"68633a6449ee051499b088e5593d13eca08c912394e1ec1d80a7ed1a3013a5c7"}
Jul 20 17:48:12.709495 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.709470    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal" event={"ID":"b10c9a794a263c36b584cb10f4cb7998","Type":"ContainerStarted","Data":"2b2fec86c68c535e9c04c33c4a58f6b224d99ee933387d6772ae3aefd765631c"}
Jul 20 17:48:12.719650 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.719621    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 17:43:13 +0000 UTC" deadline="2028-01-28 05:57:34.977263169 +0000 UTC"
Jul 20 17:48:12.719650 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:12.719647    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13356h9m22.25761929s"
Jul 20 17:48:14.237929 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:14.237904    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-126.ec2.internal\" not found"
Jul 20 17:48:14.249788 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.249736    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 17:48:14.276201 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.276179    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 17:48:14.289930 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.289906    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:14.339252 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.339219    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 17:48:14.340200 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.340188    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-126.ec2.internal"
Jul 20 17:48:14.355536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.355516    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 17:48:14.968666 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.968415    2562 apiserver.go:52] "Watching apiserver"
Jul 20 17:48:14.977755 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.977731    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 17:48:14.979155 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.979103    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-9mpmw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk","openshift-cluster-node-tuning-operator/tuned-g7cbv","openshift-multus/multus-additional-cni-plugins-2grlg","openshift-multus/multus-mhvkd","kube-system/kube-apiserver-proxy-ip-10-0-141-126.ec2.internal","openshift-dns/node-resolver-z4fqh","openshift-image-registry/node-ca-rzclt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal","openshift-multus/network-metrics-daemon-vvz9s","openshift-network-diagnostics/network-check-target-8kqmt","openshift-network-operator/iptables-alerter-j99md","openshift-ovn-kubernetes/ovnkube-node-bw4s4","kube-system/global-pull-secret-syncer-klwnn"]
Jul 20 17:48:14.980611 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.980589    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4fqh"
Jul 20 17:48:14.987052 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.987029    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:14.988767 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.988747    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 17:48:14.988854 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.988776    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 17:48:14.988854 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.988788    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5qspx\""
Jul 20 17:48:14.989068 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.989053    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:14.990622 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.990606    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 17:48:14.991361 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.991345    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:14.992259 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.991979    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:14.993204 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.993185    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:14.993302 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:14.993254    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:14.995367 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.995344    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 17:48:14.996000 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.995983    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rzclt"
Jul 20 17:48:14.996786 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.996766    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7vvt7\""
Jul 20 17:48:14.996989 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.996972    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 17:48:14.997178 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.997160    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 17:48:14.997347 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.997333    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 17:48:14.998007 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.997988    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 17:48:14.998262 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.998245    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 17:48:14.998498 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.998479    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8zzvs\""
Jul 20 17:48:14.998749 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.998727    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 17:48:14.998943 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.998909    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:14.999333 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:14.999316    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.000113 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.000094    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:15.000195 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.000156    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:15.000814 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.000795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-cnibin\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.000906 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.000825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-os-release\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.000906 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.000847    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-etc-kubernetes\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-run-systemd\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-tuned\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2969127-3b92-4a1d-a54d-11a8ceb63dfe-hosts-file\") pod \"node-resolver-z4fqh\" (UID: \"a2969127-3b92-4a1d-a54d-11a8ceb63dfe\") " pod="openshift-dns/node-resolver-z4fqh"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klpbc\" (UniqueName: \"kubernetes.io/projected/a2969127-3b92-4a1d-a54d-11a8ceb63dfe-kube-api-access-klpbc\") pod \"node-resolver-z4fqh\" (UID: \"a2969127-3b92-4a1d-a54d-11a8ceb63dfe\") " pod="openshift-dns/node-resolver-z4fqh"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-cni-netd\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001418    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42a4b929-6e2a-4eea-9024-ae72d1c67124-tmp\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-node-log\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mq7j\" (UniqueName: \"kubernetes.io/projected/9010d336-f5bf-432d-b960-b9a225398d04-kube-api-access-6mq7j\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-var-lib-kubelet\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-hostroot\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-dbus\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001591    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-kubelet\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-run-openvswitch\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001653    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-cnibin\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-cni-binary-copy\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.002468 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.001717    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:15.003365 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001751    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-socket-dir-parent\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.003365 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-run-multus-certs\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.003365 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.003365 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.001869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-host\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.003365 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.002305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b477afb8-158e-4ee9-9a0f-d21e836646b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.003365 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.002355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-run-netns\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.003365 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.002384    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-var-lib-cni-bin\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.003776 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.003674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-log-socket\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.003776 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.003716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-cni-bin\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.003776 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.003747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-sys\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.003938 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.003809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wslpv\" (UniqueName: \"kubernetes.io/projected/42a4b929-6e2a-4eea-9024-ae72d1c67124-kube-api-access-wslpv\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.004382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9010d336-f5bf-432d-b960-b9a225398d04-ovn-node-metrics-cert\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.004463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-lib-modules\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.004503    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j99md"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.004509    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b477afb8-158e-4ee9-9a0f-d21e836646b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.004544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b477afb8-158e-4ee9-9a0f-d21e836646b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.004570    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.004899    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-sysctl-d\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.005000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-run\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.005136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-os-release\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.005449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-conf-dir\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.005511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-slash\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.005555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-var-lib-openvswitch\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.005852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-run-ovn\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.005888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-run-ovn-kubernetes\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.005985    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-var-lib-cni-multus\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.006017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-kubelet-config\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:15.007043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.006413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-systemd-units\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.007899 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.006449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-modprobe-d\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.007899 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.006480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-daemon-config\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.007899 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.006506    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2969127-3b92-4a1d-a54d-11a8ceb63dfe-tmp-dir\") pod \"node-resolver-z4fqh\" (UID: \"a2969127-3b92-4a1d-a54d-11a8ceb63dfe\") " pod="openshift-dns/node-resolver-z4fqh"
Jul 20 17:48:15.007899 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.006626    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-run-netns\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.007899 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.006656    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9010d336-f5bf-432d-b960-b9a225398d04-ovnkube-script-lib\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.007899 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.006684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-sysconfig\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.007899 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.006713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-kubernetes\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.007899 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.006770    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-systemd\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.007899 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.007024    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.006969    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-system-cni-dir\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.008924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46szs\" (UniqueName: \"kubernetes.io/projected/b477afb8-158e-4ee9-9a0f-d21e836646b0-kube-api-access-46szs\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.008957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-run-k8s-cni-cncf-io\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.008988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.009018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-cni-dir\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.009047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfbls\" (UniqueName: \"kubernetes.io/projected/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-kube-api-access-jfbls\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.009077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-etc-openvswitch\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.009105    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9010d336-f5bf-432d-b960-b9a225398d04-ovnkube-config\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.009135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9010d336-f5bf-432d-b960-b9a225398d04-env-overrides\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.009172    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-sysctl-conf\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.009197    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-var-lib-kubelet\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.009225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-system-cni-dir\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.009418 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.009371    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 17:48:15.010131 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.010073    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 17:48:15.011243 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.010456    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f8trf\""
Jul 20 17:48:15.011243 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.010636    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 17:48:15.011243 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.010789    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n82g4\""
Jul 20 17:48:15.011243 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.010879    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 17:48:15.011243 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.010879    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 17:48:15.011243 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.011012    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vfmwj\""
Jul 20 17:48:15.011243 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.011040    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 17:48:15.011243 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.011068    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 17:48:15.011729 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.011267    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 17:48:15.012986 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.012524    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-52jkk\""
Jul 20 17:48:15.012986 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.012673    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 17:48:15.012986 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.012897    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 17:48:15.013551 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.013528    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 17:48:15.013551 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.013544    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 17:48:15.013718 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.013703    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gxl2d\""
Jul 20 17:48:15.013810 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.013797    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 17:48:15.014674 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.014651    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 17:48:15.026202 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.026181    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 17:48:15.026368 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.026350    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 17:48:15.026464 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.026382    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wxztv\""
Jul 20 17:48:15.026678 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.026660    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 17:48:15.042775 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.042269    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 17:48:15.091691 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.091668    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 17:48:15.109623 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-var-lib-kubelet\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.109778 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-hostroot\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.109778 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-dbus\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:15.109778 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlxpk\" (UniqueName: \"kubernetes.io/projected/b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4-kube-api-access-mlxpk\") pod \"node-ca-rzclt\" (UID: \"b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4\") " pod="openshift-image-registry/node-ca-rzclt"
Jul 20 17:48:15.109778 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-socket-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.109778 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-kubelet\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.109778 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-run-openvswitch\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.109778 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-cnibin\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-cni-binary-copy\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-socket-dir-parent\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-run-multus-certs\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgn7r\" (UniqueName: \"kubernetes.io/projected/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-kube-api-access-wgn7r\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-host\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b477afb8-158e-4ee9-9a0f-d21e836646b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-run-netns\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-etc-selinux\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h8n5\" (UniqueName: \"kubernetes.io/projected/10018892-ce37-41d3-8c3f-2e43682209fc-kube-api-access-8h8n5\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-var-lib-cni-bin\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.109982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-log-socket\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-cni-bin\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.110039 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-sys\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wslpv\" (UniqueName: \"kubernetes.io/projected/42a4b929-6e2a-4eea-9024-ae72d1c67124-kube-api-access-wslpv\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9010d336-f5bf-432d-b960-b9a225398d04-ovn-node-metrics-cert\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-lib-modules\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b477afb8-158e-4ee9-9a0f-d21e836646b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b477afb8-158e-4ee9-9a0f-d21e836646b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6ae8fb4-a744-48e4-aebb-1dbe6db610e3-agent-certs\") pod \"konnectivity-agent-9mpmw\" (UID: \"d6ae8fb4-a744-48e4-aebb-1dbe6db610e3\") " pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110176    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-sysctl-d\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110203    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-run\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-os-release\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110236    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-conf-dir\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-slash\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-var-lib-openvswitch\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-run-ovn\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-run-ovn-kubernetes\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110317    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-var-lib-cni-multus\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.110536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-kubelet-config\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-registration-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-systemd-units\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-modprobe-d\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110434    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4-serviceca\") pod \"node-ca-rzclt\" (UID: \"b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4\") " pod="openshift-image-registry/node-ca-rzclt"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110484    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-log-socket\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110612    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-run\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110660    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-hostroot\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110665    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-var-lib-kubelet\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110706    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-os-release\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110726    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-dbus\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110749    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-conf-dir\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110778    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-slash\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110784    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-kubelet\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110811    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-run-ovn\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110829    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-run-openvswitch\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-var-lib-openvswitch\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110887    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-socket-dir-parent\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.111173 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-run-ovn-kubernetes\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110920    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-var-lib-cni-multus\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110935    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-run-multus-certs\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110965    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-kubelet-config\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-systemd-units\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111054    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-modprobe-d\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.110621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-sysctl-d\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111095    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111121    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-host\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-sys\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111173    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-run-netns\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111216    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-var-lib-cni-bin\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6-host-slash\") pod \"iptables-alerter-j99md\" (UID: \"7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6\") " pod="openshift-network-operator/iptables-alerter-j99md"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-daemon-config\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2969127-3b92-4a1d-a54d-11a8ceb63dfe-tmp-dir\") pod \"node-resolver-z4fqh\" (UID: \"a2969127-3b92-4a1d-a54d-11a8ceb63dfe\") " pod="openshift-dns/node-resolver-z4fqh"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6ae8fb4-a744-48e4-aebb-1dbe6db610e3-konnectivity-ca\") pod \"konnectivity-agent-9mpmw\" (UID: \"d6ae8fb4-a744-48e4-aebb-1dbe6db610e3\") " pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:15.111904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqfx8\" (UniqueName: \"kubernetes.io/projected/7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6-kube-api-access-lqfx8\") pod \"iptables-alerter-j99md\" (UID: \"7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6\") " pod="openshift-network-operator/iptables-alerter-j99md"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-run-netns\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9010d336-f5bf-432d-b960-b9a225398d04-ovnkube-script-lib\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-sysconfig\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-kubernetes\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111492    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-systemd\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-system-cni-dir\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46szs\" (UniqueName: \"kubernetes.io/projected/b477afb8-158e-4ee9-9a0f-d21e836646b0-kube-api-access-46szs\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111547    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b477afb8-158e-4ee9-9a0f-d21e836646b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-device-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111611    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-cnibin\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.111684    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-kubernetes\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112168    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-cni-binary-copy\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-run-k8s-cni-cncf-io\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112272    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-cni-dir\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112286    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-daemon-config\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.112752 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfbls\" (UniqueName: \"kubernetes.io/projected/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-kube-api-access-jfbls\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112326    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-etc-openvswitch\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9010d336-f5bf-432d-b960-b9a225398d04-ovnkube-config\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9010d336-f5bf-432d-b960-b9a225398d04-env-overrides\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112426    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-sysctl-conf\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-var-lib-kubelet\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-system-cni-dir\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112501    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-cnibin\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112516    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2969127-3b92-4a1d-a54d-11a8ceb63dfe-tmp-dir\") pod \"node-resolver-z4fqh\" (UID: \"a2969127-3b92-4a1d-a54d-11a8ceb63dfe\") " pod="openshift-dns/node-resolver-z4fqh"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-os-release\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-etc-kubernetes\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-system-cni-dir\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112568    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-run-netns\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112611    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-host-run-k8s-cni-cncf-io\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112616    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-systemd\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112694    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112738    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-sysctl-conf\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112750    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-var-lib-kubelet\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.113533 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112789    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-multus-cni-dir\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112802    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-system-cni-dir\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112831    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-etc-openvswitch\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxqg5\" (UniqueName: \"kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5\") pod \"network-check-target-8kqmt\" (UID: \"124db77e-3818-4ea2-9259-6fc48ca36c55\") " pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112848    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-cnibin\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112867    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-etc-kubernetes\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-run-systemd\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-sysconfig\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112952    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-run-systemd\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112961    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b477afb8-158e-4ee9-9a0f-d21e836646b0-os-release\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-tuned\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.112999    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-cni-bin\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2969127-3b92-4a1d-a54d-11a8ceb63dfe-hosts-file\") pod \"node-resolver-z4fqh\" (UID: \"a2969127-3b92-4a1d-a54d-11a8ceb63dfe\") " pod="openshift-dns/node-resolver-z4fqh"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klpbc\" (UniqueName: \"kubernetes.io/projected/a2969127-3b92-4a1d-a54d-11a8ceb63dfe-kube-api-access-klpbc\") pod \"node-resolver-z4fqh\" (UID: \"a2969127-3b92-4a1d-a54d-11a8ceb63dfe\") " pod="openshift-dns/node-resolver-z4fqh"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6-iptables-alerter-script\") pod \"iptables-alerter-j99md\" (UID: \"7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6\") " pod="openshift-network-operator/iptables-alerter-j99md"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-cni-netd\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42a4b929-6e2a-4eea-9024-ae72d1c67124-tmp\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4-host\") pod \"node-ca-rzclt\" (UID: \"b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4\") " pod="openshift-image-registry/node-ca-rzclt"
Jul 20 17:48:15.114421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-sys-fs\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.115017 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-node-log\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.115017 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mq7j\" (UniqueName: \"kubernetes.io/projected/9010d336-f5bf-432d-b960-b9a225398d04-kube-api-access-6mq7j\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.115017 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113345    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9010d336-f5bf-432d-b960-b9a225398d04-env-overrides\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.115017 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113460    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9010d336-f5bf-432d-b960-b9a225398d04-ovnkube-script-lib\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.115017 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113514    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a2969127-3b92-4a1d-a54d-11a8ceb63dfe-hosts-file\") pod \"node-resolver-z4fqh\" (UID: \"a2969127-3b92-4a1d-a54d-11a8ceb63dfe\") " pod="openshift-dns/node-resolver-z4fqh"
Jul 20 17:48:15.115017 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-host-cni-netd\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.115017 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113805    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 17:48:15.115017 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.113834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9010d336-f5bf-432d-b960-b9a225398d04-ovnkube-config\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.115017 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.114055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9010d336-f5bf-432d-b960-b9a225398d04-node-log\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.115017 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.114468    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b477afb8-158e-4ee9-9a0f-d21e836646b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.115017 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.114567    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42a4b929-6e2a-4eea-9024-ae72d1c67124-lib-modules\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.115377 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.115103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b477afb8-158e-4ee9-9a0f-d21e836646b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.115377 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.115185    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:15.115377 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.115245    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret podName:b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:15.615227504 +0000 UTC m=+2.986820741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret") pod "global-pull-secret-syncer-klwnn" (UID: "b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:15.118330 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.118156    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42a4b929-6e2a-4eea-9024-ae72d1c67124-etc-tuned\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.118330 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.118285    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9010d336-f5bf-432d-b960-b9a225398d04-ovn-node-metrics-cert\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.118732 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.118712    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42a4b929-6e2a-4eea-9024-ae72d1c67124-tmp\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.132682 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.132645    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-56qms"
Jul 20 17:48:15.139184 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.139122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wslpv\" (UniqueName: \"kubernetes.io/projected/42a4b929-6e2a-4eea-9024-ae72d1c67124-kube-api-access-wslpv\") pod \"tuned-g7cbv\" (UID: \"42a4b929-6e2a-4eea-9024-ae72d1c67124\") " pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.158629 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.158603    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfbls\" (UniqueName: \"kubernetes.io/projected/7e000655-bdbd-460d-ad3b-3e76ce9e9b81-kube-api-access-jfbls\") pod \"multus-mhvkd\" (UID: \"7e000655-bdbd-460d-ad3b-3e76ce9e9b81\") " pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.160289 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.160258    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46szs\" (UniqueName: \"kubernetes.io/projected/b477afb8-158e-4ee9-9a0f-d21e836646b0-kube-api-access-46szs\") pod \"multus-additional-cni-plugins-2grlg\" (UID: \"b477afb8-158e-4ee9-9a0f-d21e836646b0\") " pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.161167 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.161126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klpbc\" (UniqueName: \"kubernetes.io/projected/a2969127-3b92-4a1d-a54d-11a8ceb63dfe-kube-api-access-klpbc\") pod \"node-resolver-z4fqh\" (UID: \"a2969127-3b92-4a1d-a54d-11a8ceb63dfe\") " pod="openshift-dns/node-resolver-z4fqh"
Jul 20 17:48:15.162800 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.162761    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mq7j\" (UniqueName: \"kubernetes.io/projected/9010d336-f5bf-432d-b960-b9a225398d04-kube-api-access-6mq7j\") pod \"ovnkube-node-bw4s4\" (UID: \"9010d336-f5bf-432d-b960-b9a225398d04\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.191558 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.191534    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-56qms"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.213870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-registration-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.213915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4-serviceca\") pod \"node-ca-rzclt\" (UID: \"b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4\") " pod="openshift-image-registry/node-ca-rzclt"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.213940    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.213964    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6-host-slash\") pod \"iptables-alerter-j99md\" (UID: \"7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6\") " pod="openshift-network-operator/iptables-alerter-j99md"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6ae8fb4-a744-48e4-aebb-1dbe6db610e3-konnectivity-ca\") pod \"konnectivity-agent-9mpmw\" (UID: \"d6ae8fb4-a744-48e4-aebb-1dbe6db610e3\") " pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214024    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqfx8\" (UniqueName: \"kubernetes.io/projected/7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6-kube-api-access-lqfx8\") pod \"iptables-alerter-j99md\" (UID: \"7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6\") " pod="openshift-network-operator/iptables-alerter-j99md"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214019    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-registration-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.214062    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214076    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-device-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxqg5\" (UniqueName: \"kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5\") pod \"network-check-target-8kqmt\" (UID: \"124db77e-3818-4ea2-9259-6fc48ca36c55\") " pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.214129    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs podName:10018892-ce37-41d3-8c3f-2e43682209fc nodeName:}" failed. No retries permitted until 2026-07-20 17:48:15.714103379 +0000 UTC m=+3.085696616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs") pod "network-metrics-daemon-vvz9s" (UID: "10018892-ce37-41d3-8c3f-2e43682209fc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6-iptables-alerter-script\") pod \"iptables-alerter-j99md\" (UID: \"7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6\") " pod="openshift-network-operator/iptables-alerter-j99md"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4-host\") pod \"node-ca-rzclt\" (UID: \"b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4\") " pod="openshift-image-registry/node-ca-rzclt"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-sys-fs\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlxpk\" (UniqueName: \"kubernetes.io/projected/b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4-kube-api-access-mlxpk\") pod \"node-ca-rzclt\" (UID: \"b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4\") " pod="openshift-image-registry/node-ca-rzclt"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-socket-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.214991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214331    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgn7r\" (UniqueName: \"kubernetes.io/projected/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-kube-api-access-wgn7r\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214359    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-etc-selinux\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h8n5\" (UniqueName: \"kubernetes.io/projected/10018892-ce37-41d3-8c3f-2e43682209fc-kube-api-access-8h8n5\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4-serviceca\") pod \"node-ca-rzclt\" (UID: \"b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4\") " pod="openshift-image-registry/node-ca-rzclt"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6ae8fb4-a744-48e4-aebb-1dbe6db610e3-agent-certs\") pod \"konnectivity-agent-9mpmw\" (UID: \"d6ae8fb4-a744-48e4-aebb-1dbe6db610e3\") " pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6-host-slash\") pod \"iptables-alerter-j99md\" (UID: \"7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6\") " pod="openshift-network-operator/iptables-alerter-j99md"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-device-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214696    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d6ae8fb4-a744-48e4-aebb-1dbe6db610e3-konnectivity-ca\") pod \"konnectivity-agent-9mpmw\" (UID: \"d6ae8fb4-a744-48e4-aebb-1dbe6db610e3\") " pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214839    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-etc-selinux\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4-host\") pod \"node-ca-rzclt\" (UID: \"b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4\") " pod="openshift-image-registry/node-ca-rzclt"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.214934    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-socket-dir\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.215796 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.215427    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-sys-fs\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.216342 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.215904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6-iptables-alerter-script\") pod \"iptables-alerter-j99md\" (UID: \"7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6\") " pod="openshift-network-operator/iptables-alerter-j99md"
Jul 20 17:48:15.217472 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.217437    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d6ae8fb4-a744-48e4-aebb-1dbe6db610e3-agent-certs\") pod \"konnectivity-agent-9mpmw\" (UID: \"d6ae8fb4-a744-48e4-aebb-1dbe6db610e3\") " pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:15.248871 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.248804    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:48:15.248871 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.248829    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:48:15.248871 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.248839    2562 projected.go:196] Error preparing data for projected volume kube-api-access-cxqg5 for pod openshift-network-diagnostics/network-check-target-8kqmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:15.249045 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.248919    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5 podName:124db77e-3818-4ea2-9259-6fc48ca36c55 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:15.748904299 +0000 UTC m=+3.120497537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cxqg5" (UniqueName: "kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5") pod "network-check-target-8kqmt" (UID: "124db77e-3818-4ea2-9259-6fc48ca36c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:15.267761 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.267723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h8n5\" (UniqueName: \"kubernetes.io/projected/10018892-ce37-41d3-8c3f-2e43682209fc-kube-api-access-8h8n5\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:15.267882 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.267738    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqfx8\" (UniqueName: \"kubernetes.io/projected/7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6-kube-api-access-lqfx8\") pod \"iptables-alerter-j99md\" (UID: \"7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6\") " pod="openshift-network-operator/iptables-alerter-j99md"
Jul 20 17:48:15.269114 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.269082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlxpk\" (UniqueName: \"kubernetes.io/projected/b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4-kube-api-access-mlxpk\") pod \"node-ca-rzclt\" (UID: \"b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4\") " pod="openshift-image-registry/node-ca-rzclt"
Jul 20 17:48:15.270343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.270325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgn7r\" (UniqueName: \"kubernetes.io/projected/3c133a85-5efd-47bd-a75f-9b5cc06bd90d-kube-api-access-wgn7r\") pod \"aws-ebs-csi-driver-node-sbcgk\" (UID: \"3c133a85-5efd-47bd-a75f-9b5cc06bd90d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.311453 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.311425    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z4fqh"
Jul 20 17:48:15.320983 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.320959    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:15.332760 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.332735    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g7cbv"
Jul 20 17:48:15.338298 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.338280    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2grlg"
Jul 20 17:48:15.345966 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.345942    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mhvkd"
Jul 20 17:48:15.356167 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.356150    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rzclt"
Jul 20 17:48:15.363966 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.363951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:15.372653 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.372637    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk"
Jul 20 17:48:15.382183 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.382165    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j99md"
Jul 20 17:48:15.617279 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.617200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:15.617437 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.617326    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:15.617437 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.617407    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret podName:b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:16.617377219 +0000 UTC m=+3.988970456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret") pod "global-pull-secret-syncer-klwnn" (UID: "b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:15.718468 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.718437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:15.718630 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.718581    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:15.718685 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.718645    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs podName:10018892-ce37-41d3-8c3f-2e43682209fc nodeName:}" failed. No retries permitted until 2026-07-20 17:48:16.718625583 +0000 UTC m=+4.090218819 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs") pod "network-metrics-daemon-vvz9s" (UID: "10018892-ce37-41d3-8c3f-2e43682209fc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:15.819328 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:15.819288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxqg5\" (UniqueName: \"kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5\") pod \"network-check-target-8kqmt\" (UID: \"124db77e-3818-4ea2-9259-6fc48ca36c55\") " pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:15.819506 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.819463    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:48:15.819506 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.819487    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:48:15.819506 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.819498    2562 projected.go:196] Error preparing data for projected volume kube-api-access-cxqg5 for pod openshift-network-diagnostics/network-check-target-8kqmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:15.819625 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:15.819551    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5 podName:124db77e-3818-4ea2-9259-6fc48ca36c55 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:16.819537083 +0000 UTC m=+4.191130320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxqg5" (UniqueName: "kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5") pod "network-check-target-8kqmt" (UID: "124db77e-3818-4ea2-9259-6fc48ca36c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:15.925437 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:15.925412    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bfa7364_9e4d_422d_8a3f_b775dfc8e0b6.slice/crio-201e440f2f3b1b5b0ac95896b1b52f6ca402ca1eee18ae9f782ee3f9a0836dd2 WatchSource:0}: Error finding container 201e440f2f3b1b5b0ac95896b1b52f6ca402ca1eee18ae9f782ee3f9a0836dd2: Status 404 returned error can't find the container with id 201e440f2f3b1b5b0ac95896b1b52f6ca402ca1eee18ae9f782ee3f9a0836dd2
Jul 20 17:48:15.926977 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:15.926962    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c133a85_5efd_47bd_a75f_9b5cc06bd90d.slice/crio-e2daafd5b06cad7a5c940c86ca55ae3a439bb9b6f81f00167a689ce9ad23a496 WatchSource:0}: Error finding container e2daafd5b06cad7a5c940c86ca55ae3a439bb9b6f81f00167a689ce9ad23a496: Status 404 returned error can't find the container with id e2daafd5b06cad7a5c940c86ca55ae3a439bb9b6f81f00167a689ce9ad23a496
Jul 20 17:48:15.927664 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:15.927626    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9010d336_f5bf_432d_b960_b9a225398d04.slice/crio-9b26204598b178397f416d15be4022988f9862b0b1d63386716cf3fe64013144 WatchSource:0}: Error finding container 9b26204598b178397f416d15be4022988f9862b0b1d63386716cf3fe64013144: Status 404 returned error can't find the container with id 9b26204598b178397f416d15be4022988f9862b0b1d63386716cf3fe64013144
Jul 20 17:48:15.928412 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:15.928375    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2969127_3b92_4a1d_a54d_11a8ceb63dfe.slice/crio-b499e477969d13a693620c6f5f9e46016b7c8d18d080d6d4d148e8c99dc1a212 WatchSource:0}: Error finding container b499e477969d13a693620c6f5f9e46016b7c8d18d080d6d4d148e8c99dc1a212: Status 404 returned error can't find the container with id b499e477969d13a693620c6f5f9e46016b7c8d18d080d6d4d148e8c99dc1a212
Jul 20 17:48:15.929252 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:15.929234    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ae8fb4_a744_48e4_aebb_1dbe6db610e3.slice/crio-0c00388616f8ea76616617372f10d33d513ab0b26e6caf1ca8c844d3ce158b92 WatchSource:0}: Error finding container 0c00388616f8ea76616617372f10d33d513ab0b26e6caf1ca8c844d3ce158b92: Status 404 returned error can't find the container with id 0c00388616f8ea76616617372f10d33d513ab0b26e6caf1ca8c844d3ce158b92
Jul 20 17:48:15.932145 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:15.932078    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb477afb8_158e_4ee9_9a0f_d21e836646b0.slice/crio-fbdb7bb317f6e9f288646cba04e35730f89264a225aab885c6ade96ed0970191 WatchSource:0}: Error finding container fbdb7bb317f6e9f288646cba04e35730f89264a225aab885c6ade96ed0970191: Status 404 returned error can't find the container with id fbdb7bb317f6e9f288646cba04e35730f89264a225aab885c6ade96ed0970191
Jul 20 17:48:15.933966 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:15.933481    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a4b929_6e2a_4eea_9024_ae72d1c67124.slice/crio-a1bc3a478e061c96d3ac0df6440d95bc76cc0df1a449338d6f25881263663157 WatchSource:0}: Error finding container a1bc3a478e061c96d3ac0df6440d95bc76cc0df1a449338d6f25881263663157: Status 404 returned error can't find the container with id a1bc3a478e061c96d3ac0df6440d95bc76cc0df1a449338d6f25881263663157
Jul 20 17:48:15.935818 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:15.935800    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9eeb81b_2fff_4b4d_b2d3_97e3120b66d4.slice/crio-fa8556fc173a9485e964a2188f5b21490a36da10fff82c72cc07de2bc8da884b WatchSource:0}: Error finding container fa8556fc173a9485e964a2188f5b21490a36da10fff82c72cc07de2bc8da884b: Status 404 returned error can't find the container with id fa8556fc173a9485e964a2188f5b21490a36da10fff82c72cc07de2bc8da884b
Jul 20 17:48:15.936738 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:15.936705    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e000655_bdbd_460d_ad3b_3e76ce9e9b81.slice/crio-f69dc971654d1426a9885420f7bb35e961f1ebb16afbb13cd27d5e9ce72eb254 WatchSource:0}: Error finding container f69dc971654d1426a9885420f7bb35e961f1ebb16afbb13cd27d5e9ce72eb254: Status 404 returned error can't find the container with id f69dc971654d1426a9885420f7bb35e961f1ebb16afbb13cd27d5e9ce72eb254
Jul 20 17:48:16.175084 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.174924    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:16.175551 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:16.175164    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:16.183150 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.183124    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rzclt" event={"ID":"b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4","Type":"ContainerStarted","Data":"fa8556fc173a9485e964a2188f5b21490a36da10fff82c72cc07de2bc8da884b"}
Jul 20 17:48:16.184155 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.184134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2grlg" event={"ID":"b477afb8-158e-4ee9-9a0f-d21e836646b0","Type":"ContainerStarted","Data":"fbdb7bb317f6e9f288646cba04e35730f89264a225aab885c6ade96ed0970191"}
Jul 20 17:48:16.185151 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.185129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4fqh" event={"ID":"a2969127-3b92-4a1d-a54d-11a8ceb63dfe","Type":"ContainerStarted","Data":"b499e477969d13a693620c6f5f9e46016b7c8d18d080d6d4d148e8c99dc1a212"}
Jul 20 17:48:16.186228 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.186189    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk" event={"ID":"3c133a85-5efd-47bd-a75f-9b5cc06bd90d","Type":"ContainerStarted","Data":"e2daafd5b06cad7a5c940c86ca55ae3a439bb9b6f81f00167a689ce9ad23a496"}
Jul 20 17:48:16.187251 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.187231    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j99md" event={"ID":"7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6","Type":"ContainerStarted","Data":"201e440f2f3b1b5b0ac95896b1b52f6ca402ca1eee18ae9f782ee3f9a0836dd2"}
Jul 20 17:48:16.189067 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.189047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-126.ec2.internal" event={"ID":"9e2eefae3baccec91f5e5bfac1588b9a","Type":"ContainerStarted","Data":"63852dd95940017dbfdac7fb5cfee6fecc7d8823157612d7c40bbec0a900346f"}
Jul 20 17:48:16.190638 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.190611    2562 generic.go:356] "Generic (PLEG): container finished" podID="b10c9a794a263c36b584cb10f4cb7998" containerID="a16a3c9a2428533b8b9dc4b0eca39b7414388e52120971e62623f8425601dfcb" exitCode=0
Jul 20 17:48:16.190717 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.190673    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal" event={"ID":"b10c9a794a263c36b584cb10f4cb7998","Type":"ContainerDied","Data":"a16a3c9a2428533b8b9dc4b0eca39b7414388e52120971e62623f8425601dfcb"}
Jul 20 17:48:16.191804 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.191774    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g7cbv" event={"ID":"42a4b929-6e2a-4eea-9024-ae72d1c67124","Type":"ContainerStarted","Data":"a1bc3a478e061c96d3ac0df6440d95bc76cc0df1a449338d6f25881263663157"}
Jul 20 17:48:16.192919 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.192900    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhvkd" event={"ID":"7e000655-bdbd-460d-ad3b-3e76ce9e9b81","Type":"ContainerStarted","Data":"f69dc971654d1426a9885420f7bb35e961f1ebb16afbb13cd27d5e9ce72eb254"}
Jul 20 17:48:16.193461 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.193420    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 17:43:15 +0000 UTC" deadline="2028-04-09 05:01:34.562574104 +0000 UTC"
Jul 20 17:48:16.193461 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.193461    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15083h13m18.369115762s"
Jul 20 17:48:16.193948 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.193932    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9mpmw" event={"ID":"d6ae8fb4-a744-48e4-aebb-1dbe6db610e3","Type":"ContainerStarted","Data":"0c00388616f8ea76616617372f10d33d513ab0b26e6caf1ca8c844d3ce158b92"}
Jul 20 17:48:16.195003 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.194918    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4" event={"ID":"9010d336-f5bf-432d-b960-b9a225398d04","Type":"ContainerStarted","Data":"9b26204598b178397f416d15be4022988f9862b0b1d63386716cf3fe64013144"}
Jul 20 17:48:16.290303 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.290242    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-126.ec2.internal" podStartSLOduration=2.2902211230000002 podStartE2EDuration="2.290221123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:16.288699017 +0000 UTC m=+3.660292277" watchObservedRunningTime="2026-07-20 17:48:16.290221123 +0000 UTC m=+3.661814383"
Jul 20 17:48:16.628419 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.628291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:16.628582 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:16.628499    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:16.628582 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:16.628565    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret podName:b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:18.628545188 +0000 UTC m=+6.000138428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret") pod "global-pull-secret-syncer-klwnn" (UID: "b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:16.729323 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.729236    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:16.729508 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:16.729443    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:16.729582 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:16.729517    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs podName:10018892-ce37-41d3-8c3f-2e43682209fc nodeName:}" failed. No retries permitted until 2026-07-20 17:48:18.729493024 +0000 UTC m=+6.101086265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs") pod "network-metrics-daemon-vvz9s" (UID: "10018892-ce37-41d3-8c3f-2e43682209fc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:16.830490 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:16.829831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxqg5\" (UniqueName: \"kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5\") pod \"network-check-target-8kqmt\" (UID: \"124db77e-3818-4ea2-9259-6fc48ca36c55\") " pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:16.830490 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:16.830047    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:48:16.830490 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:16.830066    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:48:16.830490 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:16.830080    2562 projected.go:196] Error preparing data for projected volume kube-api-access-cxqg5 for pod openshift-network-diagnostics/network-check-target-8kqmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:16.830490 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:16.830141    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5 podName:124db77e-3818-4ea2-9259-6fc48ca36c55 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:18.830120299 +0000 UTC m=+6.201713569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxqg5" (UniqueName: "kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5") pod "network-check-target-8kqmt" (UID: "124db77e-3818-4ea2-9259-6fc48ca36c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:17.175082 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:17.175004    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:17.175213 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:17.175141    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:17.177730 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:17.177703    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:17.177835 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:17.177813    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:17.194382 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:17.193965    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 17:43:15 +0000 UTC" deadline="2028-02-13 20:46:30.039235749 +0000 UTC"
Jul 20 17:48:17.194382 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:17.193995    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13754h58m12.845245019s"
Jul 20 17:48:17.225544 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:17.225511    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal" event={"ID":"b10c9a794a263c36b584cb10f4cb7998","Type":"ContainerStarted","Data":"a506388a0d17b2fe33defd98a6a86e158263ef1d6222bb19cc05ca41dfa7e75b"}
Jul 20 17:48:17.288621 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:17.288558    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-126.ec2.internal" podStartSLOduration=3.288535368 podStartE2EDuration="3.288535368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:17.288180693 +0000 UTC m=+4.659773954" watchObservedRunningTime="2026-07-20 17:48:17.288535368 +0000 UTC m=+4.660128628"
Jul 20 17:48:18.174420 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:18.174006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:18.174420 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:18.174116    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:18.645329 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:18.645228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:18.645777 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:18.645454    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:18.645777 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:18.645567    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret podName:b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:22.64551153 +0000 UTC m=+10.017104782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret") pod "global-pull-secret-syncer-klwnn" (UID: "b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:18.746570 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:18.746533    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:18.746720 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:18.746698    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:18.746822 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:18.746808    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs podName:10018892-ce37-41d3-8c3f-2e43682209fc nodeName:}" failed. No retries permitted until 2026-07-20 17:48:22.74678868 +0000 UTC m=+10.118381920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs") pod "network-metrics-daemon-vvz9s" (UID: "10018892-ce37-41d3-8c3f-2e43682209fc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:18.847653 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:18.847614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxqg5\" (UniqueName: \"kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5\") pod \"network-check-target-8kqmt\" (UID: \"124db77e-3818-4ea2-9259-6fc48ca36c55\") " pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:18.847835 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:18.847787    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:48:18.847835 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:18.847809    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:48:18.847835 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:18.847821    2562 projected.go:196] Error preparing data for projected volume kube-api-access-cxqg5 for pod openshift-network-diagnostics/network-check-target-8kqmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:18.847994 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:18.847880    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5 podName:124db77e-3818-4ea2-9259-6fc48ca36c55 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:22.847859656 +0000 UTC m=+10.219452896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxqg5" (UniqueName: "kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5") pod "network-check-target-8kqmt" (UID: "124db77e-3818-4ea2-9259-6fc48ca36c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:19.176255 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:19.175514    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:19.176255 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:19.175654    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:19.176255 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:19.175688    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:19.176255 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:19.175816    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:20.174576 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:20.174544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:20.174944 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:20.174656    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:21.176507 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:21.176477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:21.176878 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:21.176606    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:21.176878 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:21.176690    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:21.176878 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:21.176793    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:22.175018 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:22.174982    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:22.175188 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:22.175130    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:22.678062 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:22.677949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:22.678543 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:22.678091    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:22.678543 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:22.678169    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret podName:b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:30.678148052 +0000 UTC m=+18.049741291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret") pod "global-pull-secret-syncer-klwnn" (UID: "b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:22.778953 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:22.778913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:22.779129 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:22.779107    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:22.779189 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:22.779169    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs podName:10018892-ce37-41d3-8c3f-2e43682209fc nodeName:}" failed. No retries permitted until 2026-07-20 17:48:30.7791503 +0000 UTC m=+18.150743544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs") pod "network-metrics-daemon-vvz9s" (UID: "10018892-ce37-41d3-8c3f-2e43682209fc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:22.879570 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:22.879526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxqg5\" (UniqueName: \"kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5\") pod \"network-check-target-8kqmt\" (UID: \"124db77e-3818-4ea2-9259-6fc48ca36c55\") " pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:22.879755 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:22.879724    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:48:22.879755 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:22.879746    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:48:22.879860 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:22.879759    2562 projected.go:196] Error preparing data for projected volume kube-api-access-cxqg5 for pod openshift-network-diagnostics/network-check-target-8kqmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:22.879860 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:22.879816    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5 podName:124db77e-3818-4ea2-9259-6fc48ca36c55 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:30.879797222 +0000 UTC m=+18.251390475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxqg5" (UniqueName: "kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5") pod "network-check-target-8kqmt" (UID: "124db77e-3818-4ea2-9259-6fc48ca36c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:23.175321 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:23.175244    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:23.175473 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:23.175356    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:23.175886 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:23.175858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:23.175998 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:23.175974    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:24.174734 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:24.174693    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:24.175143 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:24.174870    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:25.174909 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:25.174875    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:25.175357 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:25.175007    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:25.175457 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:25.175373    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:25.175509 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:25.175493    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:26.175013 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:26.174978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:26.175491 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:26.175096    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:27.175204 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:27.174714    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:27.175204 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:27.174850    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:27.175204 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:27.174915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:27.175204 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:27.175031    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:28.174170 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:28.174127    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:28.174325 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:28.174283    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:29.174406 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:29.174353    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:29.174821 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:29.174509    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:29.174821 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:29.174564    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:29.174821 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:29.174681    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:30.174733 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:30.174697    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:30.175182 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:30.174830    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:30.739641 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:30.739543    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:30.739791 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:30.739689    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:30.739791 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:30.739758    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret podName:b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:46.739739367 +0000 UTC m=+34.111332610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret") pod "global-pull-secret-syncer-klwnn" (UID: "b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:30.840616 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:30.840576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:30.840784 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:30.840741    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:30.840847 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:30.840827    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs podName:10018892-ce37-41d3-8c3f-2e43682209fc nodeName:}" failed. No retries permitted until 2026-07-20 17:48:46.84080484 +0000 UTC m=+34.212398107 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs") pod "network-metrics-daemon-vvz9s" (UID: "10018892-ce37-41d3-8c3f-2e43682209fc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:30.941304 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:30.941267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxqg5\" (UniqueName: \"kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5\") pod \"network-check-target-8kqmt\" (UID: \"124db77e-3818-4ea2-9259-6fc48ca36c55\") " pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:30.941524 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:30.941484    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:48:30.941524 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:30.941510    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:48:30.941524 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:30.941523    2562 projected.go:196] Error preparing data for projected volume kube-api-access-cxqg5 for pod openshift-network-diagnostics/network-check-target-8kqmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:30.941644 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:30.941603    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5 podName:124db77e-3818-4ea2-9259-6fc48ca36c55 nodeName:}" failed. No retries permitted until 2026-07-20 17:48:46.941576165 +0000 UTC m=+34.313169438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxqg5" (UniqueName: "kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5") pod "network-check-target-8kqmt" (UID: "124db77e-3818-4ea2-9259-6fc48ca36c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:31.174825 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:31.174738    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:31.175260 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:31.174744    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:31.175260 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:31.174880    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:31.175260 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:31.174946    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:32.174034 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:32.173996    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:32.174201 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:32.174139    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:33.175114 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:33.175083    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:33.175599 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:33.175189    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:33.175599 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:33.175535    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:33.175690 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:33.175608    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:34.174944 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:34.174909    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:34.175102 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:34.175035    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:35.174096 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.174069    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:35.174427 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:35.174184    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:35.174501 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.174450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:35.174605 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:35.174562    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:35.267659 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.267380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4" event={"ID":"9010d336-f5bf-432d-b960-b9a225398d04","Type":"ContainerStarted","Data":"d6dffba819b07f033270130679c2f80cb432c0ce0df025e5a3916b92776993b4"}
Jul 20 17:48:35.268854 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.268833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rzclt" event={"ID":"b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4","Type":"ContainerStarted","Data":"00d4d25bac6972c8c1733948dfbdf93bde9238421485a889396d77f7b8787c67"}
Jul 20 17:48:35.270351 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.270329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2grlg" event={"ID":"b477afb8-158e-4ee9-9a0f-d21e836646b0","Type":"ContainerStarted","Data":"957be50ca3c19a228b78381f1c33eec054980628bc3bb48123f65f283cbb8d06"}
Jul 20 17:48:35.272143 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.272125    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z4fqh" event={"ID":"a2969127-3b92-4a1d-a54d-11a8ceb63dfe","Type":"ContainerStarted","Data":"6c19428aad7c9f921f47343717029a2a18794473bba84e8044ce9c4836a21cb9"}
Jul 20 17:48:35.273552 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.273531    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk" event={"ID":"3c133a85-5efd-47bd-a75f-9b5cc06bd90d","Type":"ContainerStarted","Data":"e95331995b5199ceef2fc440411cff443db45de40f4c5ece1080773eeeda1426"}
Jul 20 17:48:35.277121 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.277071    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g7cbv" event={"ID":"42a4b929-6e2a-4eea-9024-ae72d1c67124","Type":"ContainerStarted","Data":"609f103b9b5a85e57d9a19ff5e74f8e23ea6d1397436e133917c8cc3f02eeb23"}
Jul 20 17:48:35.278650 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.278524    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9mpmw" event={"ID":"d6ae8fb4-a744-48e4-aebb-1dbe6db610e3","Type":"ContainerStarted","Data":"398fbdc808e2ef056e6907f1b781b6055f3b4341a39ac3d1f334e577016d319f"}
Jul 20 17:48:35.318029 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.317973    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rzclt" podStartSLOduration=3.29542904 podStartE2EDuration="22.317954822s" totalImagesPullingTime="19.022525782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:35.31540792 +0000 UTC m=+22.687001182" watchObservedRunningTime="2026-07-20 17:48:35.317954822 +0000 UTC m=+22.689548081"
Jul 20 17:48:35.454975 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.453115    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g7cbv" podStartSLOduration=3.445108186 podStartE2EDuration="22.453095618s" totalImagesPullingTime="19.007987432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:35.451330302 +0000 UTC m=+22.822923561" watchObservedRunningTime="2026-07-20 17:48:35.453095618 +0000 UTC m=+22.824688875"
Jul 20 17:48:35.454975 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.454054    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z4fqh" podStartSLOduration=3.403983429 podStartE2EDuration="22.45403665s" totalImagesPullingTime="19.050053221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:35.364657219 +0000 UTC m=+22.736250478" watchObservedRunningTime="2026-07-20 17:48:35.45403665 +0000 UTC m=+22.825629910"
Jul 20 17:48:35.572375 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.572329    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9mpmw" podStartSLOduration=3.562053385 podStartE2EDuration="22.57231246s" totalImagesPullingTime="19.010259075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:35.572230902 +0000 UTC m=+22.943824158" watchObservedRunningTime="2026-07-20 17:48:35.57231246 +0000 UTC m=+22.943905718"
Jul 20 17:48:35.695264 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.695229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:35.859610 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:35.859581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:36.047320 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.047284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:36.174632 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.174569    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:36.175552 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:36.174707    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:36.283209 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.283162    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mhvkd" event={"ID":"7e000655-bdbd-460d-ad3b-3e76ce9e9b81","Type":"ContainerStarted","Data":"7dbba174aac027772576f6fc4574615774e669dcba4131068522685d4bdb98ec"}
Jul 20 17:48:36.286170 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.286149    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 17:48:36.286550 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.286528    2562 generic.go:356] "Generic (PLEG): container finished" podID="9010d336-f5bf-432d-b960-b9a225398d04" containerID="c7191063f2f31153113a79483ebc70d028e4a62361b15d829c02021e9b4e10b6" exitCode=1
Jul 20 17:48:36.286663 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.286595    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4" event={"ID":"9010d336-f5bf-432d-b960-b9a225398d04","Type":"ContainerStarted","Data":"097e78ed2df267679558f181151b8f30258cd5e69f4b2f8887f5bcd3b6936742"}
Jul 20 17:48:36.286717 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.286667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4" event={"ID":"9010d336-f5bf-432d-b960-b9a225398d04","Type":"ContainerStarted","Data":"ddf2874184a43d6f72a145f1b35d8e46bf1fd285b6a3f10710ea899b5018cffe"}
Jul 20 17:48:36.286717 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.286699    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4" event={"ID":"9010d336-f5bf-432d-b960-b9a225398d04","Type":"ContainerStarted","Data":"94f796da66641199f1b08c6b606bd9ef744529bda15999fdcf29075352a766b4"}
Jul 20 17:48:36.286784 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.286735    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4" event={"ID":"9010d336-f5bf-432d-b960-b9a225398d04","Type":"ContainerStarted","Data":"1cad995cb398f3a5e85b882420e77d31b32da15bb2647a89618fd088f81761b7"}
Jul 20 17:48:36.286823 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.286781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4" event={"ID":"9010d336-f5bf-432d-b960-b9a225398d04","Type":"ContainerDied","Data":"c7191063f2f31153113a79483ebc70d028e4a62361b15d829c02021e9b4e10b6"}
Jul 20 17:48:36.288325 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.288299    2562 generic.go:356] "Generic (PLEG): container finished" podID="b477afb8-158e-4ee9-9a0f-d21e836646b0" containerID="957be50ca3c19a228b78381f1c33eec054980628bc3bb48123f65f283cbb8d06" exitCode=0
Jul 20 17:48:36.288437 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.288337    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2grlg" event={"ID":"b477afb8-158e-4ee9-9a0f-d21e836646b0","Type":"ContainerDied","Data":"957be50ca3c19a228b78381f1c33eec054980628bc3bb48123f65f283cbb8d06"}
Jul 20 17:48:36.290131 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.290107    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j99md" event={"ID":"7bfa7364-9e4d-422d-8a3f-b775dfc8e0b6","Type":"ContainerStarted","Data":"89b7950db4750968a535d0473b923ce5cc339920a705097ee0f5851ff162ba79"}
Jul 20 17:48:36.360564 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.360518    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mhvkd" podStartSLOduration=3.979737451 podStartE2EDuration="23.360501611s" totalImagesPullingTime="19.38076416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:36.320821427 +0000 UTC m=+23.692414688" watchObservedRunningTime="2026-07-20 17:48:36.360501611 +0000 UTC m=+23.732094870"
Jul 20 17:48:36.360789 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.360768    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j99md" podStartSLOduration=4.344081793 podStartE2EDuration="23.360764534s" totalImagesPullingTime="19.016682741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:36.358550965 +0000 UTC m=+23.730144224" watchObservedRunningTime="2026-07-20 17:48:36.360764534 +0000 UTC m=+23.732357794"
Jul 20 17:48:36.591248 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.591217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:36.758357 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.758308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:36.942513 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:36.942480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:37.083165 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:37.083141    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 17:48:37.117895 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:37.117864    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:37.174979 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:37.174951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:37.175455 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:37.174951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:37.175455 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:37.175125    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:37.175455 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:37.175176    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:37.297683 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:37.297598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk" event={"ID":"3c133a85-5efd-47bd-a75f-9b5cc06bd90d","Type":"ContainerStarted","Data":"825b9ba5698ee19a2d905e2568b94990aae090c63c80c1c42b51184b42a7a4cc"}
Jul 20 17:48:37.339243 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:37.339198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:38.064817 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:38.064626    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T17:48:37.083157947Z","UUID":"974fe963-5b03-4ca4-83a0-d805b28dbf82","Handler":null,"Name":"","Endpoint":""}
Jul 20 17:48:38.066283 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:38.066261    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 17:48:38.066410 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:38.066299    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 17:48:38.174127 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:38.174097    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:38.174415 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:38.174242    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:38.303950 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:38.303923    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 17:48:38.304411 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:38.304362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4" event={"ID":"9010d336-f5bf-432d-b960-b9a225398d04","Type":"ContainerStarted","Data":"f7821acd0893da34f238ce406fb72cf1d29c87b3b4b08119f6a2d93d244aa26e"}
Jul 20 17:48:39.175972 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:39.175944    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:39.176166 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:39.176055    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:39.176166 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:39.176081    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:39.176285 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:39.176176    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:39.309718 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:39.309679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk" event={"ID":"3c133a85-5efd-47bd-a75f-9b5cc06bd90d","Type":"ContainerStarted","Data":"00520605ad13f7ed83239eb23f2e09df93116fa8c2d9f54ff2ff127aa1cc1836"}
Jul 20 17:48:39.337090 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:39.337040    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sbcgk" podStartSLOduration=4.007368293 podStartE2EDuration="26.33702524s" totalImagesPullingTime="22.329656947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:39.337013306 +0000 UTC m=+26.708606564" watchObservedRunningTime="2026-07-20 17:48:39.33702524 +0000 UTC m=+26.708618499"
Jul 20 17:48:39.624222 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:39.624190    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:39.624882 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:39.624864    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:40.174333 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:40.174108    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:40.174519 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:40.174411    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:41.174588 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:41.174555    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:41.175268 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:41.174662    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:41.175268 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:41.174718    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:41.175268 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:41.174806    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:41.316762 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:41.316734    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 17:48:41.317142 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:41.317116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4" event={"ID":"9010d336-f5bf-432d-b960-b9a225398d04","Type":"ContainerStarted","Data":"aa8d799322fa0b4547a2383244e940b65417b119e346d88a6bfb7a0498e70d3a"}
Jul 20 17:48:41.317477 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:41.317444    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:41.317596 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:41.317521    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:41.317660 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:41.317628    2562 scope.go:117] "RemoveContainer" containerID="c7191063f2f31153113a79483ebc70d028e4a62361b15d829c02021e9b4e10b6"
Jul 20 17:48:41.319370 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:41.319343    2562 generic.go:356] "Generic (PLEG): container finished" podID="b477afb8-158e-4ee9-9a0f-d21e836646b0" containerID="f5cf97de56ae07a9469280f52d6938a1b166699e59a882d41ef555a5234f6636" exitCode=0
Jul 20 17:48:41.319493 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:41.319422    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2grlg" event={"ID":"b477afb8-158e-4ee9-9a0f-d21e836646b0","Type":"ContainerDied","Data":"f5cf97de56ae07a9469280f52d6938a1b166699e59a882d41ef555a5234f6636"}
Jul 20 17:48:41.336373 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:41.336334    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:41.337139 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:41.337120    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:42.175011 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.174830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:42.175446 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:42.175098    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:42.326006 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.325978    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 17:48:42.326349 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.326328    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4" event={"ID":"9010d336-f5bf-432d-b960-b9a225398d04","Type":"ContainerStarted","Data":"1b3bc35c78e9ea3377ee3b5929b83af89313f3397ffc9c6f2669e2b5d91172b1"}
Jul 20 17:48:42.326721 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.326708    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:48:42.371285 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.371234    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4" podStartSLOduration=10.284935232 podStartE2EDuration="29.371219583s" totalImagesPullingTime="19.086284351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:42.369965853 +0000 UTC m=+29.741559114" watchObservedRunningTime="2026-07-20 17:48:42.371219583 +0000 UTC m=+29.742812863"
Jul 20 17:48:42.374138 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.374088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:42.478128 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.477017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:42.726673 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.726650    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klwnn"]
Jul 20 17:48:42.726788 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.726776    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:42.726872 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:42.726856    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:42.732276 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.732205    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vvz9s"]
Jul 20 17:48:42.732375 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.732337    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:42.732494 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:42.732468    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:42.732905 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.732884    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8kqmt"]
Jul 20 17:48:42.732998 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:42.732985    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:42.733103 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:42.733086    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:43.331042 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:43.331014    2562 generic.go:356] "Generic (PLEG): container finished" podID="b477afb8-158e-4ee9-9a0f-d21e836646b0" containerID="16055e0092c5f16eb3f416287303f3a93348c8bae40fabdfe2582b04abb1a2fa" exitCode=0
Jul 20 17:48:43.331442 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:43.331101    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2grlg" event={"ID":"b477afb8-158e-4ee9-9a0f-d21e836646b0","Type":"ContainerDied","Data":"16055e0092c5f16eb3f416287303f3a93348c8bae40fabdfe2582b04abb1a2fa"}
Jul 20 17:48:43.379707 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:43.379676    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:43.502754 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:43.502720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:44.174023 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:44.173991    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:44.174239 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:44.174100    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:44.174239 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:44.174108    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:44.174239 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:44.174129    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:44.174239 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:44.174211    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:44.174481 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:44.174281    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:44.513885 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:44.513702    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:44.514247 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:44.514021    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 17:48:44.514343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:44.514321    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9mpmw"
Jul 20 17:48:44.703040 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:44.703011    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:45.338267 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:45.338234    2562 generic.go:356] "Generic (PLEG): container finished" podID="b477afb8-158e-4ee9-9a0f-d21e836646b0" containerID="8892a272353f56d859e36561fb586406627c85b321eb55698069616e938ad960" exitCode=0
Jul 20 17:48:45.338492 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:45.338319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2grlg" event={"ID":"b477afb8-158e-4ee9-9a0f-d21e836646b0","Type":"ContainerDied","Data":"8892a272353f56d859e36561fb586406627c85b321eb55698069616e938ad960"}
Jul 20 17:48:46.174731 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:46.174694    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:46.174731 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:46.174726    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:46.175178 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:46.174735    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:46.175178 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:46.174819    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kqmt" podUID="124db77e-3818-4ea2-9259-6fc48ca36c55"
Jul 20 17:48:46.175178 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:46.174948    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vvz9s" podUID="10018892-ce37-41d3-8c3f-2e43682209fc"
Jul 20 17:48:46.175178 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:46.175026    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klwnn" podUID="b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7"
Jul 20 17:48:46.752064 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:46.752033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:46.752230 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:46.752162    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:46.752287 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:46.752232    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret podName:b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:18.752212681 +0000 UTC m=+66.123805922 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret") pod "global-pull-secret-syncer-klwnn" (UID: "b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7") : object "kube-system"/"original-pull-secret" not registered
Jul 20 17:48:46.811175 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:46.811135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:46.853051 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:46.853011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:46.853214 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:46.853126    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:46.853214 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:46.853206    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs podName:10018892-ce37-41d3-8c3f-2e43682209fc nodeName:}" failed. No retries permitted until 2026-07-20 17:49:18.853183547 +0000 UTC m=+66.224776798 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs") pod "network-metrics-daemon-vvz9s" (UID: "10018892-ce37-41d3-8c3f-2e43682209fc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 17:48:46.914154 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:46.914114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:46.954142 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:46.954108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxqg5\" (UniqueName: \"kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5\") pod \"network-check-target-8kqmt\" (UID: \"124db77e-3818-4ea2-9259-6fc48ca36c55\") " pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:46.954362 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:46.954262    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 17:48:46.954362 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:46.954277    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 17:48:46.954362 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:46.954287    2562 projected.go:196] Error preparing data for projected volume kube-api-access-cxqg5 for pod openshift-network-diagnostics/network-check-target-8kqmt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:46.954362 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:46.954330    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5 podName:124db77e-3818-4ea2-9259-6fc48ca36c55 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:18.954316689 +0000 UTC m=+66.325909925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cxqg5" (UniqueName: "kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5") pod "network-check-target-8kqmt" (UID: "124db77e-3818-4ea2-9259-6fc48ca36c55") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 17:48:47.051148 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:47.051039    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:48.011897 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.011817    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-126.ec2.internal" event="NodeReady"
Jul 20 17:48:48.012463 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.011969    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 17:48:48.080120 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.080087    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bcffb"]
Jul 20 17:48:48.082777 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.082758    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.085615 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.085590    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2clqc"]
Jul 20 17:48:48.085759 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.085743    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 17:48:48.085811 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.085793    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nkvwc\""
Jul 20 17:48:48.086089 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.086072    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 17:48:48.087350 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.087328    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2clqc"
Jul 20 17:48:48.090947 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.090928    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 17:48:48.091046 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.090927    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 17:48:48.091234 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.091217    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 17:48:48.091294 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.091278    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v69jf\""
Jul 20 17:48:48.100912 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.100894    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bcffb"]
Jul 20 17:48:48.109343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.109319    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2clqc"]
Jul 20 17:48:48.165062 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.165022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-config-volume\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.165241 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.165088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.165241 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.165135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-tmp-dir\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.165241 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.165160    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlxbp\" (UniqueName: \"kubernetes.io/projected/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-kube-api-access-jlxbp\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.174078 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.174047    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:48:48.174225 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.174168    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:48:48.174225 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.174180    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:48:48.179028 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.178857    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 17:48:48.179302 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.179162    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 17:48:48.179302 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.179163    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zcx42\""
Jul 20 17:48:48.179302 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.179163    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 17:48:48.179564 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.179549    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mjfj5\""
Jul 20 17:48:48.179633 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.179620    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 17:48:48.266343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.266252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db49fa4a-eacc-488f-8571-6f149475787e-cert\") pod \"ingress-canary-2clqc\" (UID: \"db49fa4a-eacc-488f-8571-6f149475787e\") " pod="openshift-ingress-canary/ingress-canary-2clqc"
Jul 20 17:48:48.266343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.266301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz6n6\" (UniqueName: \"kubernetes.io/projected/db49fa4a-eacc-488f-8571-6f149475787e-kube-api-access-sz6n6\") pod \"ingress-canary-2clqc\" (UID: \"db49fa4a-eacc-488f-8571-6f149475787e\") " pod="openshift-ingress-canary/ingress-canary-2clqc"
Jul 20 17:48:48.266585 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.266367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-config-volume\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.266585 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.266406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.266585 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.266479    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-tmp-dir\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.266585 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.266514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlxbp\" (UniqueName: \"kubernetes.io/projected/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-kube-api-access-jlxbp\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.266585 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:48.266519    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:48:48.266585 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:48.266576    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls podName:0c3d3546-4f0b-48ef-9b2d-4bae9593b53f nodeName:}" failed. No retries permitted until 2026-07-20 17:48:48.766561783 +0000 UTC m=+36.138155020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls") pod "dns-default-bcffb" (UID: "0c3d3546-4f0b-48ef-9b2d-4bae9593b53f") : secret "dns-default-metrics-tls" not found
Jul 20 17:48:48.266954 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.266935    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-tmp-dir\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.267109 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.267090    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-config-volume\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.280076 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.280050    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlxbp\" (UniqueName: \"kubernetes.io/projected/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-kube-api-access-jlxbp\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.367133 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.367096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db49fa4a-eacc-488f-8571-6f149475787e-cert\") pod \"ingress-canary-2clqc\" (UID: \"db49fa4a-eacc-488f-8571-6f149475787e\") " pod="openshift-ingress-canary/ingress-canary-2clqc"
Jul 20 17:48:48.367317 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.367153    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz6n6\" (UniqueName: \"kubernetes.io/projected/db49fa4a-eacc-488f-8571-6f149475787e-kube-api-access-sz6n6\") pod \"ingress-canary-2clqc\" (UID: \"db49fa4a-eacc-488f-8571-6f149475787e\") " pod="openshift-ingress-canary/ingress-canary-2clqc"
Jul 20 17:48:48.370199 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.370165    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db49fa4a-eacc-488f-8571-6f149475787e-cert\") pod \"ingress-canary-2clqc\" (UID: \"db49fa4a-eacc-488f-8571-6f149475787e\") " pod="openshift-ingress-canary/ingress-canary-2clqc"
Jul 20 17:48:48.379016 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.378995    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz6n6\" (UniqueName: \"kubernetes.io/projected/db49fa4a-eacc-488f-8571-6f149475787e-kube-api-access-sz6n6\") pod \"ingress-canary-2clqc\" (UID: \"db49fa4a-eacc-488f-8571-6f149475787e\") " pod="openshift-ingress-canary/ingress-canary-2clqc"
Jul 20 17:48:48.394273 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.394242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:48.401112 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.401084    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2clqc"
Jul 20 17:48:48.769936 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:48.769903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:48.770120 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:48.770076    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:48:48.770181 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:48.770138    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls podName:0c3d3546-4f0b-48ef-9b2d-4bae9593b53f nodeName:}" failed. No retries permitted until 2026-07-20 17:48:49.770117208 +0000 UTC m=+37.141710446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls") pod "dns-default-bcffb" (UID: "0c3d3546-4f0b-48ef-9b2d-4bae9593b53f") : secret "dns-default-metrics-tls" not found
Jul 20 17:48:49.380217 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:49.380027    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2clqc"]
Jul 20 17:48:49.384156 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:48:49.384112    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb49fa4a_eacc_488f_8571_6f149475787e.slice/crio-c363d9bedcbf482df16d8848edac383c8f2ee80bc3d92873ffa0c138491723eb WatchSource:0}: Error finding container c363d9bedcbf482df16d8848edac383c8f2ee80bc3d92873ffa0c138491723eb: Status 404 returned error can't find the container with id c363d9bedcbf482df16d8848edac383c8f2ee80bc3d92873ffa0c138491723eb
Jul 20 17:48:49.778681 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:49.778643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:49.778861 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:49.778760    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:48:49.778861 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:49.778814    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls podName:0c3d3546-4f0b-48ef-9b2d-4bae9593b53f nodeName:}" failed. No retries permitted until 2026-07-20 17:48:51.778800756 +0000 UTC m=+39.150393993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls") pod "dns-default-bcffb" (UID: "0c3d3546-4f0b-48ef-9b2d-4bae9593b53f") : secret "dns-default-metrics-tls" not found
Jul 20 17:48:50.354454 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:50.354418    2562 generic.go:356] "Generic (PLEG): container finished" podID="b477afb8-158e-4ee9-9a0f-d21e836646b0" containerID="48e0a27558b7330bce50ea50594e1b9b058d4744a7be48511064c2399a2ac0b4" exitCode=0
Jul 20 17:48:50.354606 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:50.354519    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2grlg" event={"ID":"b477afb8-158e-4ee9-9a0f-d21e836646b0","Type":"ContainerDied","Data":"48e0a27558b7330bce50ea50594e1b9b058d4744a7be48511064c2399a2ac0b4"}
Jul 20 17:48:50.355809 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:50.355751    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2clqc" event={"ID":"db49fa4a-eacc-488f-8571-6f149475787e","Type":"ContainerStarted","Data":"c363d9bedcbf482df16d8848edac383c8f2ee80bc3d92873ffa0c138491723eb"}
Jul 20 17:48:51.361827 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:51.361788    2562 generic.go:356] "Generic (PLEG): container finished" podID="b477afb8-158e-4ee9-9a0f-d21e836646b0" containerID="21185f83d401712e06ff9cddbdbedd6843d5cb30f06994f715d7c73e796bbc2c" exitCode=0
Jul 20 17:48:51.362294 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:51.361834    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2grlg" event={"ID":"b477afb8-158e-4ee9-9a0f-d21e836646b0","Type":"ContainerDied","Data":"21185f83d401712e06ff9cddbdbedd6843d5cb30f06994f715d7c73e796bbc2c"}
Jul 20 17:48:51.720140 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:51.720084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:51.794791 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:51.794766    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:51.794905 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:51.794888    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:48:51.794968 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:51.794959    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls podName:0c3d3546-4f0b-48ef-9b2d-4bae9593b53f nodeName:}" failed. No retries permitted until 2026-07-20 17:48:55.794939761 +0000 UTC m=+43.166533016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls") pod "dns-default-bcffb" (UID: "0c3d3546-4f0b-48ef-9b2d-4bae9593b53f") : secret "dns-default-metrics-tls" not found
Jul 20 17:48:51.819254 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:51.819230    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:52.146231 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:52.146064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:52.225856 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:52.225828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:52.368364 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:52.368331    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2grlg" event={"ID":"b477afb8-158e-4ee9-9a0f-d21e836646b0","Type":"ContainerStarted","Data":"94a4981dd167dbdbab6203e7abea0daab9f69eed7745527ec415ba5ab0dd4cd9"}
Jul 20 17:48:52.369854 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:52.369833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2clqc" event={"ID":"db49fa4a-eacc-488f-8571-6f149475787e","Type":"ContainerStarted","Data":"b1725dd1971e91bc290af7c7750afc097e4f9d4023e7e4d0c4554cbafae387b9"}
Jul 20 17:48:52.409631 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:52.407424    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2grlg" podStartSLOduration=9.535457135 podStartE2EDuration="39.407379455s" totalImagesPullingTime="29.87192232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:52.406994986 +0000 UTC m=+39.778588243" watchObservedRunningTime="2026-07-20 17:48:52.407379455 +0000 UTC m=+39.778972715"
Jul 20 17:48:52.429723 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:52.429673    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2clqc" podStartSLOduration=2.062390663 podStartE2EDuration="4.429658084s" totalImagesPullingTime="2.367267421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:48:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:48:52.42847306 +0000 UTC m=+39.800066319" watchObservedRunningTime="2026-07-20 17:48:52.429658084 +0000 UTC m=+39.801251402"
Jul 20 17:48:52.565763 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:52.565730    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:52.776027 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:52.775949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:54.262195 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:54.262154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:54.361977 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:54.361942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:48:55.824094 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:48:55.824050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:48:55.824529 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:55.824204    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:48:55.824529 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:48:55.824271    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls podName:0c3d3546-4f0b-48ef-9b2d-4bae9593b53f nodeName:}" failed. No retries permitted until 2026-07-20 17:49:03.82425386 +0000 UTC m=+51.195847096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls") pod "dns-default-bcffb" (UID: "0c3d3546-4f0b-48ef-9b2d-4bae9593b53f") : secret "dns-default-metrics-tls" not found
Jul 20 17:49:03.878441 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:03.878380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:49:03.878901 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:03.878515    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:49:03.878901 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:03.878578    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls podName:0c3d3546-4f0b-48ef-9b2d-4bae9593b53f nodeName:}" failed. No retries permitted until 2026-07-20 17:49:19.878563154 +0000 UTC m=+67.250156391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls") pod "dns-default-bcffb" (UID: "0c3d3546-4f0b-48ef-9b2d-4bae9593b53f") : secret "dns-default-metrics-tls" not found
Jul 20 17:49:13.349272 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:13.349244    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw4s4"
Jul 20 17:49:13.555597 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:13.555559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:15.076619 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:15.076581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:18.781227 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:18.781191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:49:18.784789 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:18.784772    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 17:49:18.795371 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:18.795344    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7-original-pull-secret\") pod \"global-pull-secret-syncer-klwnn\" (UID: \"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7\") " pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:49:18.881834 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:18.881795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:49:18.884944 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:18.884925    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 17:49:18.892603 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:18.892588    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 17:49:18.892706 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:18.892695    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs podName:10018892-ce37-41d3-8c3f-2e43682209fc nodeName:}" failed. No retries permitted until 2026-07-20 17:50:22.892679053 +0000 UTC m=+130.264272290 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs") pod "network-metrics-daemon-vvz9s" (UID: "10018892-ce37-41d3-8c3f-2e43682209fc") : secret "metrics-daemon-secret" not found
Jul 20 17:49:18.983131 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:18.983097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxqg5\" (UniqueName: \"kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5\") pod \"network-check-target-8kqmt\" (UID: \"124db77e-3818-4ea2-9259-6fc48ca36c55\") " pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:49:18.986497 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:18.986480    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 17:49:18.997183 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:18.997163    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 17:49:19.007253 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:19.007222    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxqg5\" (UniqueName: \"kubernetes.io/projected/124db77e-3818-4ea2-9259-6fc48ca36c55-kube-api-access-cxqg5\") pod \"network-check-target-8kqmt\" (UID: \"124db77e-3818-4ea2-9259-6fc48ca36c55\") " pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:49:19.085381 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:19.085297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klwnn"
Jul 20 17:49:19.095255 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:19.095127    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zcx42\""
Jul 20 17:49:19.102690 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:19.102666    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:49:19.220746 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:19.220711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klwnn"]
Jul 20 17:49:19.224768 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:49:19.224745    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb84c5ac1_f9bb_4665_b5cc_8aa55e9087d7.slice/crio-af9cd6c6ff36f8ee485c0a545db47cde8389fa67af561961cffcd728f30e7633 WatchSource:0}: Error finding container af9cd6c6ff36f8ee485c0a545db47cde8389fa67af561961cffcd728f30e7633: Status 404 returned error can't find the container with id af9cd6c6ff36f8ee485c0a545db47cde8389fa67af561961cffcd728f30e7633
Jul 20 17:49:19.241096 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:19.241069    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8kqmt"]
Jul 20 17:49:19.245239 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:49:19.245218    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124db77e_3818_4ea2_9259_6fc48ca36c55.slice/crio-af892698d87e00cd4dbd247fc84bdc38252d6a7fcd37f508cc7e33644ff6de44 WatchSource:0}: Error finding container af892698d87e00cd4dbd247fc84bdc38252d6a7fcd37f508cc7e33644ff6de44: Status 404 returned error can't find the container with id af892698d87e00cd4dbd247fc84bdc38252d6a7fcd37f508cc7e33644ff6de44
Jul 20 17:49:19.432525 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:19.432491    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8kqmt" event={"ID":"124db77e-3818-4ea2-9259-6fc48ca36c55","Type":"ContainerStarted","Data":"af892698d87e00cd4dbd247fc84bdc38252d6a7fcd37f508cc7e33644ff6de44"}
Jul 20 17:49:19.433602 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:19.433576    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klwnn" event={"ID":"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7","Type":"ContainerStarted","Data":"af9cd6c6ff36f8ee485c0a545db47cde8389fa67af561961cffcd728f30e7633"}
Jul 20 17:49:19.889938 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:19.889902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:49:19.890433 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:19.890096    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 17:49:19.890433 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:19.890179    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls podName:0c3d3546-4f0b-48ef-9b2d-4bae9593b53f nodeName:}" failed. No retries permitted until 2026-07-20 17:49:51.890156803 +0000 UTC m=+99.261750039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls") pod "dns-default-bcffb" (UID: "0c3d3546-4f0b-48ef-9b2d-4bae9593b53f") : secret "dns-default-metrics-tls" not found
Jul 20 17:49:24.447678 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:24.447636    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8kqmt" event={"ID":"124db77e-3818-4ea2-9259-6fc48ca36c55","Type":"ContainerStarted","Data":"b995441ddfa602e513da5a580d312bee115e1548531575af4c02e810de1b1039"}
Jul 20 17:49:24.448149 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:24.447734    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:49:24.449097 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:24.449075    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klwnn" event={"ID":"b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7","Type":"ContainerStarted","Data":"687ba79a31ff3957dbad78e71a6a3061298ecaf22cdab316228f0e643d91adf2"}
Jul 20 17:49:24.470867 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:24.470822    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8kqmt" podStartSLOduration=66.925806163 podStartE2EDuration="1m11.47080748s" totalImagesPullingTime="4.545001317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:49:24.469695631 +0000 UTC m=+71.841288889" watchObservedRunningTime="2026-07-20 17:49:24.47080748 +0000 UTC m=+71.842400738"
Jul 20 17:49:24.492648 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:24.492600    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-klwnn" podStartSLOduration=66.926340031 podStartE2EDuration="1m11.492583174s" totalImagesPullingTime="4.566243143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:49:24.491271135 +0000 UTC m=+71.862864393" watchObservedRunningTime="2026-07-20 17:49:24.492583174 +0000 UTC m=+71.864176432"
Jul 20 17:49:29.801524 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.801492    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hwwxk"]
Jul 20 17:49:29.803580 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.803565    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hwwxk"
Jul 20 17:49:29.809820 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.809409    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 20 17:49:29.809820 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.809430    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 20 17:49:29.810048 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.810034    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-s9k47\""
Jul 20 17:49:29.822075 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.822050    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hwwxk"]
Jul 20 17:49:29.859076 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.859046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np8rk\" (UniqueName: \"kubernetes.io/projected/39890400-91c3-4f0c-8c4d-49dbdd9618bb-kube-api-access-np8rk\") pod \"volume-data-source-validator-78cf4c6f6-hwwxk\" (UID: \"39890400-91c3-4f0c-8c4d-49dbdd9618bb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hwwxk"
Jul 20 17:49:29.926382 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.926354    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-bc67f49fb-pmswb"]
Jul 20 17:49:29.928098 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.928084    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:29.930860 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.930835    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 20 17:49:29.931116 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.931101    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 20 17:49:29.931204 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.931133    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 20 17:49:29.931325 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.931310    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7mvgl\""
Jul 20 17:49:29.931659 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.931643    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 17:49:29.931740 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.931699    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 17:49:29.931937 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.931923    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 20 17:49:29.953319 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.953292    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bc67f49fb-pmswb"]
Jul 20 17:49:29.959663 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.959639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:29.959764 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.959687    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-default-certificate\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:29.959764 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.959713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-stats-auth\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:29.959862 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.959779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5tzz\" (UniqueName: \"kubernetes.io/projected/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-kube-api-access-f5tzz\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:29.959862 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.959804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np8rk\" (UniqueName: \"kubernetes.io/projected/39890400-91c3-4f0c-8c4d-49dbdd9618bb-kube-api-access-np8rk\") pod \"volume-data-source-validator-78cf4c6f6-hwwxk\" (UID: \"39890400-91c3-4f0c-8c4d-49dbdd9618bb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hwwxk"
Jul 20 17:49:29.959862 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.959849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:29.970386 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:29.970367    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np8rk\" (UniqueName: \"kubernetes.io/projected/39890400-91c3-4f0c-8c4d-49dbdd9618bb-kube-api-access-np8rk\") pod \"volume-data-source-validator-78cf4c6f6-hwwxk\" (UID: \"39890400-91c3-4f0c-8c4d-49dbdd9618bb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hwwxk"
Jul 20 17:49:30.032287 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.032254    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"]
Jul 20 17:49:30.033923 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.033908    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:30.046792 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.046773    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 17:49:30.047216 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.047200    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 17:49:30.047801 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.047786    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 20 17:49:30.047997 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.047981    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-x97bc\""
Jul 20 17:49:30.049146 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.049128    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 20 17:49:30.060227 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.060165    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:30.060227 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.060202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:30.060369 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.060255    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-default-certificate\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:30.060369 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.060281    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-stats-auth\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:30.060369 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:30.060332    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle podName:b4463355-2bf6-4ca6-bdcb-67dfa1131a2a nodeName:}" failed. No retries permitted until 2026-07-20 17:49:30.560310767 +0000 UTC m=+77.931904007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle") pod "router-default-bc67f49fb-pmswb" (UID: "b4463355-2bf6-4ca6-bdcb-67dfa1131a2a") : configmap references non-existent config key: service-ca.crt
Jul 20 17:49:30.060561 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.060373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5tzz\" (UniqueName: \"kubernetes.io/projected/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-kube-api-access-f5tzz\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:30.060561 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:30.060441    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 17:49:30.060561 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:30.060514    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs podName:b4463355-2bf6-4ca6-bdcb-67dfa1131a2a nodeName:}" failed. No retries permitted until 2026-07-20 17:49:30.560499013 +0000 UTC m=+77.932092253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs") pod "router-default-bc67f49fb-pmswb" (UID: "b4463355-2bf6-4ca6-bdcb-67dfa1131a2a") : secret "router-metrics-certs-default" not found
Jul 20 17:49:30.062247 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.062220    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-mjkfv"]
Jul 20 17:49:30.062830 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.062812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-default-certificate\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:30.062889 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.062880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-stats-auth\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:30.064274 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.064258    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.080425 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.080406    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 17:49:30.080523 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.080427    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-j9rjs\""
Jul 20 17:49:30.080523 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.080427    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 20 17:49:30.080706 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.080693    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 20 17:49:30.080932 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.080920    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 17:49:30.086550 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.086530    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 20 17:49:30.086700 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.086682    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"]
Jul 20 17:49:30.099052 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.099028    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5tzz\" (UniqueName: \"kubernetes.io/projected/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-kube-api-access-f5tzz\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:30.107772 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.107745    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-mjkfv"]
Jul 20 17:49:30.112004 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.111985    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hwwxk"
Jul 20 17:49:30.161421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.161374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991597ce-1aec-4c68-9f71-6d108f9be607-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.161621 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.161430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991597ce-1aec-4c68-9f71-6d108f9be607-service-ca-bundle\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.161621 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.161517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45c7n\" (UniqueName: \"kubernetes.io/projected/991597ce-1aec-4c68-9f71-6d108f9be607-kube-api-access-45c7n\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.161621 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.161540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/19cb63a8-6e43-4cde-8074-f78547077262-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:30.161621 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.161574    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/991597ce-1aec-4c68-9f71-6d108f9be607-serving-cert\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.161864 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.161646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/991597ce-1aec-4c68-9f71-6d108f9be607-snapshots\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.161864 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.161667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:30.161864 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.161686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/991597ce-1aec-4c68-9f71-6d108f9be607-tmp\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.161864 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.161704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dj5v\" (UniqueName: \"kubernetes.io/projected/19cb63a8-6e43-4cde-8074-f78547077262-kube-api-access-4dj5v\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:30.243489 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.243449    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hwwxk"]
Jul 20 17:49:30.246143 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:49:30.246120    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39890400_91c3_4f0c_8c4d_49dbdd9618bb.slice/crio-e27a8482440b4f7e9019e7b5b444c493e1a85fe1cdfc623c1748f42c2ac563ac WatchSource:0}: Error finding container e27a8482440b4f7e9019e7b5b444c493e1a85fe1cdfc623c1748f42c2ac563ac: Status 404 returned error can't find the container with id e27a8482440b4f7e9019e7b5b444c493e1a85fe1cdfc623c1748f42c2ac563ac
Jul 20 17:49:30.262879 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.262855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/991597ce-1aec-4c68-9f71-6d108f9be607-snapshots\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.262986 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.262888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:30.262986 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.262907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/991597ce-1aec-4c68-9f71-6d108f9be607-tmp\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.262986 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.262926    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dj5v\" (UniqueName: \"kubernetes.io/projected/19cb63a8-6e43-4cde-8074-f78547077262-kube-api-access-4dj5v\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:30.262986 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.262953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991597ce-1aec-4c68-9f71-6d108f9be607-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.262986 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.262978    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991597ce-1aec-4c68-9f71-6d108f9be607-service-ca-bundle\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.263212 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.263008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45c7n\" (UniqueName: \"kubernetes.io/projected/991597ce-1aec-4c68-9f71-6d108f9be607-kube-api-access-45c7n\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.263212 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:30.263019    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:30.263212 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.263027    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/19cb63a8-6e43-4cde-8074-f78547077262-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:30.263212 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.263069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/991597ce-1aec-4c68-9f71-6d108f9be607-serving-cert\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.263212 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:30.263144    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls podName:19cb63a8-6e43-4cde-8074-f78547077262 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:30.763125195 +0000 UTC m=+78.134718432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c4f4f" (UID: "19cb63a8-6e43-4cde-8074-f78547077262") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:30.263646 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.263614    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/991597ce-1aec-4c68-9f71-6d108f9be607-tmp\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.263809 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.263788    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/991597ce-1aec-4c68-9f71-6d108f9be607-snapshots\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.263877 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.263851    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991597ce-1aec-4c68-9f71-6d108f9be607-service-ca-bundle\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.263929 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.263889    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/19cb63a8-6e43-4cde-8074-f78547077262-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:30.264241 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.264219    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991597ce-1aec-4c68-9f71-6d108f9be607-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.265566 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.265552    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/991597ce-1aec-4c68-9f71-6d108f9be607-serving-cert\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.281231 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.281214    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dj5v\" (UniqueName: \"kubernetes.io/projected/19cb63a8-6e43-4cde-8074-f78547077262-kube-api-access-4dj5v\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:30.285438 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.285419    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45c7n\" (UniqueName: \"kubernetes.io/projected/991597ce-1aec-4c68-9f71-6d108f9be607-kube-api-access-45c7n\") pod \"insights-operator-555d9d7885-mjkfv\" (UID: \"991597ce-1aec-4c68-9f71-6d108f9be607\") " pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.377204 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.377159    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-mjkfv"
Jul 20 17:49:30.465082 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.465047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hwwxk" event={"ID":"39890400-91c3-4f0c-8c4d-49dbdd9618bb","Type":"ContainerStarted","Data":"e27a8482440b4f7e9019e7b5b444c493e1a85fe1cdfc623c1748f42c2ac563ac"}
Jul 20 17:49:30.511417 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.511361    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:30.521691 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.521667    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-mjkfv"]
Jul 20 17:49:30.524467 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:49:30.524440    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991597ce_1aec_4c68_9f71_6d108f9be607.slice/crio-b49a44b700e4e8895fed04a7b4f429543f0a5bcc24f0bb891bc9be68704a8bc2 WatchSource:0}: Error finding container b49a44b700e4e8895fed04a7b4f429543f0a5bcc24f0bb891bc9be68704a8bc2: Status 404 returned error can't find the container with id b49a44b700e4e8895fed04a7b4f429543f0a5bcc24f0bb891bc9be68704a8bc2
Jul 20 17:49:30.564931 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.564905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:30.565084 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.564946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:30.565084 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:30.565053    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 17:49:30.565084 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:30.565075    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle podName:b4463355-2bf6-4ca6-bdcb-67dfa1131a2a nodeName:}" failed. No retries permitted until 2026-07-20 17:49:31.565055903 +0000 UTC m=+78.936649141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle") pod "router-default-bc67f49fb-pmswb" (UID: "b4463355-2bf6-4ca6-bdcb-67dfa1131a2a") : configmap references non-existent config key: service-ca.crt
Jul 20 17:49:30.565211 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:30.565105    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs podName:b4463355-2bf6-4ca6-bdcb-67dfa1131a2a nodeName:}" failed. No retries permitted until 2026-07-20 17:49:31.565088419 +0000 UTC m=+78.936681675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs") pod "router-default-bc67f49fb-pmswb" (UID: "b4463355-2bf6-4ca6-bdcb-67dfa1131a2a") : secret "router-metrics-certs-default" not found
Jul 20 17:49:30.701254 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.701149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:30.766344 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:30.766300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:30.766516 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:30.766471    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:30.766552 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:30.766537    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls podName:19cb63a8-6e43-4cde-8074-f78547077262 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:31.766522347 +0000 UTC m=+79.138115584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c4f4f" (UID: "19cb63a8-6e43-4cde-8074-f78547077262") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:31.471769 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:31.471720    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-mjkfv" event={"ID":"991597ce-1aec-4c68-9f71-6d108f9be607","Type":"ContainerStarted","Data":"b49a44b700e4e8895fed04a7b4f429543f0a5bcc24f0bb891bc9be68704a8bc2"}
Jul 20 17:49:31.572274 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:31.572244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:31.572274 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:31.572279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:31.572479 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:31.572417    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle podName:b4463355-2bf6-4ca6-bdcb-67dfa1131a2a nodeName:}" failed. No retries permitted until 2026-07-20 17:49:33.572400136 +0000 UTC m=+80.943993385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle") pod "router-default-bc67f49fb-pmswb" (UID: "b4463355-2bf6-4ca6-bdcb-67dfa1131a2a") : configmap references non-existent config key: service-ca.crt
Jul 20 17:49:31.572479 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:31.572423    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 17:49:31.572479 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:31.572475    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs podName:b4463355-2bf6-4ca6-bdcb-67dfa1131a2a nodeName:}" failed. No retries permitted until 2026-07-20 17:49:33.572462334 +0000 UTC m=+80.944055571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs") pod "router-default-bc67f49fb-pmswb" (UID: "b4463355-2bf6-4ca6-bdcb-67dfa1131a2a") : secret "router-metrics-certs-default" not found
Jul 20 17:49:31.774815 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:31.774724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:31.774966 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:31.774855    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:31.774966 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:31.774913    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls podName:19cb63a8-6e43-4cde-8074-f78547077262 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:33.774896218 +0000 UTC m=+81.146489455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c4f4f" (UID: "19cb63a8-6e43-4cde-8074-f78547077262") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:32.476077 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:32.476040    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hwwxk" event={"ID":"39890400-91c3-4f0c-8c4d-49dbdd9618bb","Type":"ContainerStarted","Data":"aa06684469c6364a97217ec52fe17a48ff1d2850681a882391e010ef198580f8"}
Jul 20 17:49:32.503383 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:32.503335    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-hwwxk" podStartSLOduration=2.2704505 podStartE2EDuration="3.503319332s" totalImagesPullingTime="1.232868832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:49:32.502280581 +0000 UTC m=+79.873873840" watchObservedRunningTime="2026-07-20 17:49:32.503319332 +0000 UTC m=+79.874912647"
Jul 20 17:49:32.676248 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:32.676214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:32.756573 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:32.756488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:33.481270 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:33.481227    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-mjkfv" event={"ID":"991597ce-1aec-4c68-9f71-6d108f9be607","Type":"ContainerStarted","Data":"4d27692eb8d756367fe480c9e49b9c045494f75e8cca6352dc72aafa3110e93d"}
Jul 20 17:49:33.510732 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:33.510679    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-mjkfv" podStartSLOduration=2.179412733 podStartE2EDuration="4.510665049s" totalImagesPullingTime="2.331252316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:49:33.509106657 +0000 UTC m=+80.880699914" watchObservedRunningTime="2026-07-20 17:49:33.510665049 +0000 UTC m=+80.882258308"
Jul 20 17:49:33.587593 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:33.587555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:33.587743 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:33.587630    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:33.587823 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:33.587767    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 17:49:33.587823 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:33.587801    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle podName:b4463355-2bf6-4ca6-bdcb-67dfa1131a2a nodeName:}" failed. No retries permitted until 2026-07-20 17:49:37.58777888 +0000 UTC m=+84.959372118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle") pod "router-default-bc67f49fb-pmswb" (UID: "b4463355-2bf6-4ca6-bdcb-67dfa1131a2a") : configmap references non-existent config key: service-ca.crt
Jul 20 17:49:33.587914 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:33.587835    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs podName:b4463355-2bf6-4ca6-bdcb-67dfa1131a2a nodeName:}" failed. No retries permitted until 2026-07-20 17:49:37.58781555 +0000 UTC m=+84.959408789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs") pod "router-default-bc67f49fb-pmswb" (UID: "b4463355-2bf6-4ca6-bdcb-67dfa1131a2a") : secret "router-metrics-certs-default" not found
Jul 20 17:49:33.790510 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:33.790340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:33.790510 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:33.790488    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:33.790676 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:33.790563    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls podName:19cb63a8-6e43-4cde-8074-f78547077262 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:37.790546985 +0000 UTC m=+85.162140221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c4f4f" (UID: "19cb63a8-6e43-4cde-8074-f78547077262") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:34.438518 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.438485    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2p5q8"]
Jul 20 17:49:34.440549 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.440533    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.444207 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.444189    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 17:49:34.444354 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.444336    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hq7ht\""
Jul 20 17:49:34.445073 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.445060    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 17:49:34.472356 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.472330    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2p5q8"]
Jul 20 17:49:34.493967 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.493940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2nvv\" (UniqueName: \"kubernetes.io/projected/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-api-access-z2nvv\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.494293 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.493970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/586d71e8-311f-4934-ac72-c6fd66d24b98-crio-socket\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.494293 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.494000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.494293 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.494123    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.494293 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.494159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/586d71e8-311f-4934-ac72-c6fd66d24b98-data-volume\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.579735 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.579707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:34.595230 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.595197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2nvv\" (UniqueName: \"kubernetes.io/projected/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-api-access-z2nvv\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.595377 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.595234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/586d71e8-311f-4934-ac72-c6fd66d24b98-crio-socket\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.595377 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.595260    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.595377 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.595315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.595377 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.595341    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/586d71e8-311f-4934-ac72-c6fd66d24b98-crio-socket\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.595377 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.595358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/586d71e8-311f-4934-ac72-c6fd66d24b98-data-volume\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.595666 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:34.595411    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:34.595666 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:34.595431    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 17:49:34.595666 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:34.595503    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm podName:586d71e8-311f-4934-ac72-c6fd66d24b98 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:35.095484566 +0000 UTC m=+82.467077811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2p5q8" (UID: "586d71e8-311f-4934-ac72-c6fd66d24b98") : configmap "kube-rbac-proxy" not found
Jul 20 17:49:34.595666 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:34.595521    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls podName:586d71e8-311f-4934-ac72-c6fd66d24b98 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:35.095512369 +0000 UTC m=+82.467105606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2p5q8" (UID: "586d71e8-311f-4934-ac72-c6fd66d24b98") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:34.595829 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.595726    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/586d71e8-311f-4934-ac72-c6fd66d24b98-data-volume\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.616374 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.616343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2nvv\" (UniqueName: \"kubernetes.io/projected/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-api-access-z2nvv\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:34.773654 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:34.773555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:35.099684 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:35.099649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:35.099870 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:35.099768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:35.099870 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:35.099777    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 17:49:35.099870 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:35.099836    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm podName:586d71e8-311f-4934-ac72-c6fd66d24b98 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:36.099821393 +0000 UTC m=+83.471414633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2p5q8" (UID: "586d71e8-311f-4934-ac72-c6fd66d24b98") : configmap "kube-rbac-proxy" not found
Jul 20 17:49:35.100025 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:35.099888    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:35.100025 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:35.099945    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls podName:586d71e8-311f-4934-ac72-c6fd66d24b98 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:36.099930471 +0000 UTC m=+83.471523711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2p5q8" (UID: "586d71e8-311f-4934-ac72-c6fd66d24b98") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:35.220278 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:35.220239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:35.468087 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:35.467994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:35.631458 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:35.631420    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:35.798424 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:35.798315    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:35.965161 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:35.965116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:36.109023 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:36.108990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:36.109190 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:36.109046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:36.109190 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:36.109134    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 17:49:36.109190 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:36.109135    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:36.109293 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:36.109193    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm podName:586d71e8-311f-4934-ac72-c6fd66d24b98 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:38.109176454 +0000 UTC m=+85.480769693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2p5q8" (UID: "586d71e8-311f-4934-ac72-c6fd66d24b98") : configmap "kube-rbac-proxy" not found
Jul 20 17:49:36.109293 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:36.109209    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls podName:586d71e8-311f-4934-ac72-c6fd66d24b98 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:38.109201265 +0000 UTC m=+85.480794502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2p5q8" (UID: "586d71e8-311f-4934-ac72-c6fd66d24b98") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:36.694321 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:36.694296    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4fqh_a2969127-3b92-4a1d-a54d-11a8ceb63dfe/dns-node-resolver/0.log"
Jul 20 17:49:37.404577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.404545    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-2jhlh"]
Jul 20 17:49:37.407665 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.407651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-2jhlh"
Jul 20 17:49:37.416968 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.416951    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 20 17:49:37.417057 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.416951    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 20 17:49:37.417842 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.417827    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 20 17:49:37.417889 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.417837    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 20 17:49:37.417921 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.417905    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zsvrt\""
Jul 20 17:49:37.428132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.428108    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-2jhlh"]
Jul 20 17:49:37.480807 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.480769    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:37.523534 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.523507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b0aefb2f-3370-49b8-be79-337fa35f0157-signing-key\") pod \"service-ca-58598695f7-2jhlh\" (UID: \"b0aefb2f-3370-49b8-be79-337fa35f0157\") " pod="openshift-service-ca/service-ca-58598695f7-2jhlh"
Jul 20 17:49:37.523745 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.523555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b0aefb2f-3370-49b8-be79-337fa35f0157-signing-cabundle\") pod \"service-ca-58598695f7-2jhlh\" (UID: \"b0aefb2f-3370-49b8-be79-337fa35f0157\") " pod="openshift-service-ca/service-ca-58598695f7-2jhlh"
Jul 20 17:49:37.523804 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.523788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr4vl\" (UniqueName: \"kubernetes.io/projected/b0aefb2f-3370-49b8-be79-337fa35f0157-kube-api-access-vr4vl\") pod \"service-ca-58598695f7-2jhlh\" (UID: \"b0aefb2f-3370-49b8-be79-337fa35f0157\") " pod="openshift-service-ca/service-ca-58598695f7-2jhlh"
Jul 20 17:49:37.624614 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.624570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:37.624792 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.624662    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b0aefb2f-3370-49b8-be79-337fa35f0157-signing-key\") pod \"service-ca-58598695f7-2jhlh\" (UID: \"b0aefb2f-3370-49b8-be79-337fa35f0157\") " pod="openshift-service-ca/service-ca-58598695f7-2jhlh"
Jul 20 17:49:37.624792 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.624684    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:37.624792 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.624708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b0aefb2f-3370-49b8-be79-337fa35f0157-signing-cabundle\") pod \"service-ca-58598695f7-2jhlh\" (UID: \"b0aefb2f-3370-49b8-be79-337fa35f0157\") " pod="openshift-service-ca/service-ca-58598695f7-2jhlh"
Jul 20 17:49:37.624792 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.624741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4vl\" (UniqueName: \"kubernetes.io/projected/b0aefb2f-3370-49b8-be79-337fa35f0157-kube-api-access-vr4vl\") pod \"service-ca-58598695f7-2jhlh\" (UID: \"b0aefb2f-3370-49b8-be79-337fa35f0157\") " pod="openshift-service-ca/service-ca-58598695f7-2jhlh"
Jul 20 17:49:37.624792 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:37.624767    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle podName:b4463355-2bf6-4ca6-bdcb-67dfa1131a2a nodeName:}" failed. No retries permitted until 2026-07-20 17:49:45.624748526 +0000 UTC m=+92.996341762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle") pod "router-default-bc67f49fb-pmswb" (UID: "b4463355-2bf6-4ca6-bdcb-67dfa1131a2a") : configmap references non-existent config key: service-ca.crt
Jul 20 17:49:37.624989 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:37.624825    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 20 17:49:37.624989 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:37.624876    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs podName:b4463355-2bf6-4ca6-bdcb-67dfa1131a2a nodeName:}" failed. No retries permitted until 2026-07-20 17:49:45.624862179 +0000 UTC m=+92.996455415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs") pod "router-default-bc67f49fb-pmswb" (UID: "b4463355-2bf6-4ca6-bdcb-67dfa1131a2a") : secret "router-metrics-certs-default" not found
Jul 20 17:49:37.625495 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.625478    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b0aefb2f-3370-49b8-be79-337fa35f0157-signing-cabundle\") pod \"service-ca-58598695f7-2jhlh\" (UID: \"b0aefb2f-3370-49b8-be79-337fa35f0157\") " pod="openshift-service-ca/service-ca-58598695f7-2jhlh"
Jul 20 17:49:37.627175 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.627158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b0aefb2f-3370-49b8-be79-337fa35f0157-signing-key\") pod \"service-ca-58598695f7-2jhlh\" (UID: \"b0aefb2f-3370-49b8-be79-337fa35f0157\") " pod="openshift-service-ca/service-ca-58598695f7-2jhlh"
Jul 20 17:49:37.642849 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.642827    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr4vl\" (UniqueName: \"kubernetes.io/projected/b0aefb2f-3370-49b8-be79-337fa35f0157-kube-api-access-vr4vl\") pod \"service-ca-58598695f7-2jhlh\" (UID: \"b0aefb2f-3370-49b8-be79-337fa35f0157\") " pod="openshift-service-ca/service-ca-58598695f7-2jhlh"
Jul 20 17:49:37.652604 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.652574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:37.708030 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.707956    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rzclt_b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4/node-ca/0.log"
Jul 20 17:49:37.716139 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.716115    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-2jhlh"
Jul 20 17:49:37.819042 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.819009    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:37.826965 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.826939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:37.827105 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:37.827083    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:37.827156 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:37.827146    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls podName:19cb63a8-6e43-4cde-8074-f78547077262 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:45.827129174 +0000 UTC m=+93.198722411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c4f4f" (UID: "19cb63a8-6e43-4cde-8074-f78547077262") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:37.848829 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:37.848801    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-2jhlh"]
Jul 20 17:49:37.852069 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:49:37.852046    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0aefb2f_3370_49b8_be79_337fa35f0157.slice/crio-9298bcf547e2ff7f2f58d4bab6c7035f16a6f9d5fead419154c75b57167c75f1 WatchSource:0}: Error finding container 9298bcf547e2ff7f2f58d4bab6c7035f16a6f9d5fead419154c75b57167c75f1: Status 404 returned error can't find the container with id 9298bcf547e2ff7f2f58d4bab6c7035f16a6f9d5fead419154c75b57167c75f1
Jul 20 17:49:38.090247 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:38.090215    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2clqc_db49fa4a-eacc-488f-8571-6f149475787e/serve-healthcheck-canary/0.log"
Jul 20 17:49:38.129288 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:38.129255    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:38.129464 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:38.129322    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:38.129464 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:38.129378    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 17:49:38.129464 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:38.129447    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:38.129565 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:38.129467    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm podName:586d71e8-311f-4934-ac72-c6fd66d24b98 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:42.12944961 +0000 UTC m=+89.501042849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2p5q8" (UID: "586d71e8-311f-4934-ac72-c6fd66d24b98") : configmap "kube-rbac-proxy" not found
Jul 20 17:49:38.129565 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:38.129485    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls podName:586d71e8-311f-4934-ac72-c6fd66d24b98 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:42.12947399 +0000 UTC m=+89.501067226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2p5q8" (UID: "586d71e8-311f-4934-ac72-c6fd66d24b98") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:38.497151 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:38.497067    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-2jhlh" event={"ID":"b0aefb2f-3370-49b8-be79-337fa35f0157","Type":"ContainerStarted","Data":"9298bcf547e2ff7f2f58d4bab6c7035f16a6f9d5fead419154c75b57167c75f1"}
Jul 20 17:49:38.829105 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:38.829020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:40.504569 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:40.504535    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-2jhlh" event={"ID":"b0aefb2f-3370-49b8-be79-337fa35f0157","Type":"ContainerStarted","Data":"ec898a518880777024040168c8daf41a40d72f508d9a81ec4424cf61e765eadd"}
Jul 20 17:49:40.537265 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:40.537209    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-2jhlh" podStartSLOduration=1.5644161479999998 podStartE2EDuration="3.53719387s" totalImagesPullingTime="1.972777722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:49:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:49:40.535937845 +0000 UTC m=+87.907531104" watchObservedRunningTime="2026-07-20 17:49:40.53719387 +0000 UTC m=+87.908787128"
Jul 20 17:49:41.085618 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:41.085576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:41.226838 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:41.226805    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:41.352962 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:41.352927    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:41.919585 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:41.919555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:42.166056 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:42.166019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:42.166252 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:42.166134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:42.166252 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:42.166183    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:42.166252 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:42.166246    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 17:49:42.166432 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:42.166267    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls podName:586d71e8-311f-4934-ac72-c6fd66d24b98 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:50.166244954 +0000 UTC m=+97.537838191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2p5q8" (UID: "586d71e8-311f-4934-ac72-c6fd66d24b98") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:42.166432 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:42.166294    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm podName:586d71e8-311f-4934-ac72-c6fd66d24b98 nodeName:}" failed. No retries permitted until 2026-07-20 17:49:50.166282162 +0000 UTC m=+97.537875399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2p5q8" (UID: "586d71e8-311f-4934-ac72-c6fd66d24b98") : configmap "kube-rbac-proxy" not found
Jul 20 17:49:42.313092 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:42.313006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:42.906558 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:42.906521    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:43.002250 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:43.002220    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:43.312760 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:43.312678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:43.738204 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:43.738152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:43.900667 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:43.900631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:44.550373 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:44.550343    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:44.928988 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:44.928951    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:45.157097 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:45.157064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:45.325192 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:45.325100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:45.459023 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:45.458998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:45.609070 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:45.609041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:45.697575 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:45.697540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:45.697746 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:45.697603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:45.697746 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:45.697743    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle podName:b4463355-2bf6-4ca6-bdcb-67dfa1131a2a nodeName:}" failed. No retries permitted until 2026-07-20 17:50:01.697729426 +0000 UTC m=+109.069322663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle") pod "router-default-bc67f49fb-pmswb" (UID: "b4463355-2bf6-4ca6-bdcb-67dfa1131a2a") : configmap references non-existent config key: service-ca.crt
Jul 20 17:49:45.700110 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:45.700083    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-metrics-certs\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:49:45.899297 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:45.899212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:49:45.899468 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:45.899360    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:45.899468 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:45.899465    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls podName:19cb63a8-6e43-4cde-8074-f78547077262 nodeName:}" failed. No retries permitted until 2026-07-20 17:50:01.899447846 +0000 UTC m=+109.271041085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-c4f4f" (UID: "19cb63a8-6e43-4cde-8074-f78547077262") : secret "cluster-monitoring-operator-tls" not found
Jul 20 17:49:46.137265 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:46.137219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:46.753346 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:46.753309    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:46.949855 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:46.949814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:47.337908 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:47.337869    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:47.550105 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:47.550076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:47.653071 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:47.652994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:47.778402 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:47.778344    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:47.936939 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:47.936848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:48.559536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:48.559506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:48.943647 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:48.943597    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:49.185849 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:49.185815    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:49.516843 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:49.516810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:50.113166 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:50.113128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:50.230843 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:50.230803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:50.231013 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:50.230874    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:50.231013 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:50.231006    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:50.231097 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:49:50.231067    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls podName:586d71e8-311f-4934-ac72-c6fd66d24b98 nodeName:}" failed. No retries permitted until 2026-07-20 17:50:06.231053751 +0000 UTC m=+113.602646989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2p5q8" (UID: "586d71e8-311f-4934-ac72-c6fd66d24b98") : secret "insights-runtime-extractor-tls" not found
Jul 20 17:49:50.231321 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:50.231295    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/586d71e8-311f-4934-ac72-c6fd66d24b98-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:49:50.503059 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:50.502980    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:50.927320 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:50.927279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:51.092621 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:51.092592    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:51.310920 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:51.310837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:51.545121 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:51.545088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:51.699012 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:51.698982    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:51.945002 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:51.944949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:49:51.947343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:51.947317    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c3d3546-4f0b-48ef-9b2d-4bae9593b53f-metrics-tls\") pod \"dns-default-bcffb\" (UID: \"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f\") " pod="openshift-dns/dns-default-bcffb"
Jul 20 17:49:51.998887 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:51.998808    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nkvwc\""
Jul 20 17:49:52.006277 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:52.006256    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bcffb"
Jul 20 17:49:52.135711 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:52.135678    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bcffb"]
Jul 20 17:49:52.138308 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:49:52.138282    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3d3546_4f0b_48ef_9b2d_4bae9593b53f.slice/crio-8d2f9ab995f6e4e1ddf57494956d00f76485cb28b25c8ce4bed725339c29e2b4 WatchSource:0}: Error finding container 8d2f9ab995f6e4e1ddf57494956d00f76485cb28b25c8ce4bed725339c29e2b4: Status 404 returned error can't find the container with id 8d2f9ab995f6e4e1ddf57494956d00f76485cb28b25c8ce4bed725339c29e2b4
Jul 20 17:49:52.539269 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:52.539227    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bcffb" event={"ID":"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f","Type":"ContainerStarted","Data":"8d2f9ab995f6e4e1ddf57494956d00f76485cb28b25c8ce4bed725339c29e2b4"}
Jul 20 17:49:53.951372 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:53.951285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:54.050117 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:54.050080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:54.248853 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:54.248766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:54.390085 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:54.390047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:54.464625 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:54.464590    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:54.548580 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:54.548486    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bcffb" event={"ID":"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f","Type":"ContainerStarted","Data":"5c6e3022184b1b78c62534bb2819b92b02113de6aabb55f11554b8f91357441a"}
Jul 20 17:49:54.548580 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:54.548536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bcffb" event={"ID":"0c3d3546-4f0b-48ef-9b2d-4bae9593b53f","Type":"ContainerStarted","Data":"3bcc8b1e4b4b504f301070da35bab0f40648f2431134d4a152125eae0f88cabc"}
Jul 20 17:49:54.548775 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:54.548586    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bcffb"
Jul 20 17:49:54.608144 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:54.608106    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:54.685311 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:54.685259    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:55.021695 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:55.021660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:55.269520 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:55.269481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:55.455992 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:55.455959    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8kqmt"
Jul 20 17:49:55.468827 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:55.468779    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:55.485619 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:55.485566    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bcffb" podStartSLOduration=65.979128253 podStartE2EDuration="1m7.485550956s" totalImagesPullingTime="1.506422703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:48:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:49:54.574920693 +0000 UTC m=+101.946513952" watchObservedRunningTime="2026-07-20 17:49:55.485550956 +0000 UTC m=+102.857144214"
Jul 20 17:49:55.662667 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:55.662630    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:55.841006 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:55.840974    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:56.002532 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:56.002500    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:57.386662 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:57.386627    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:49:57.489012 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:49:57.488962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:01.720503 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:01.720460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:50:01.721082 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:01.721062    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4463355-2bf6-4ca6-bdcb-67dfa1131a2a-service-ca-bundle\") pod \"router-default-bc67f49fb-pmswb\" (UID: \"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a\") " pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:50:01.736627 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:01.736605    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:50:01.868995 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:01.868965    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-bc67f49fb-pmswb"]
Jul 20 17:50:01.872174 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:01.872143    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4463355_2bf6_4ca6_bdcb_67dfa1131a2a.slice/crio-5d016e6543b04262262813a92a456815bdcec27bfc002759596604d953c0da37 WatchSource:0}: Error finding container 5d016e6543b04262262813a92a456815bdcec27bfc002759596604d953c0da37: Status 404 returned error can't find the container with id 5d016e6543b04262262813a92a456815bdcec27bfc002759596604d953c0da37
Jul 20 17:50:01.922702 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:01.922678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:50:01.928506 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:01.928473    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19cb63a8-6e43-4cde-8074-f78547077262-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-c4f4f\" (UID: \"19cb63a8-6e43-4cde-8074-f78547077262\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:50:02.142076 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:02.142038    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"
Jul 20 17:50:02.286288 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:02.286254    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f"]
Jul 20 17:50:02.289901 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:02.289875    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19cb63a8_6e43_4cde_8074_f78547077262.slice/crio-da56f273379726ce54a836251abb65d1596d950fdc81d04fabfeba763853dd2e WatchSource:0}: Error finding container da56f273379726ce54a836251abb65d1596d950fdc81d04fabfeba763853dd2e: Status 404 returned error can't find the container with id da56f273379726ce54a836251abb65d1596d950fdc81d04fabfeba763853dd2e
Jul 20 17:50:02.574607 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:02.574518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f" event={"ID":"19cb63a8-6e43-4cde-8074-f78547077262","Type":"ContainerStarted","Data":"da56f273379726ce54a836251abb65d1596d950fdc81d04fabfeba763853dd2e"}
Jul 20 17:50:02.575870 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:02.575847    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bc67f49fb-pmswb" event={"ID":"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a","Type":"ContainerStarted","Data":"fc1d06d5c144b9d7d4b6a312f0fc18ff83638ab2ae8fc17206161956e690b239"}
Jul 20 17:50:02.576016 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:02.575889    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-bc67f49fb-pmswb" event={"ID":"b4463355-2bf6-4ca6-bdcb-67dfa1131a2a","Type":"ContainerStarted","Data":"5d016e6543b04262262813a92a456815bdcec27bfc002759596604d953c0da37"}
Jul 20 17:50:02.621504 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:02.621448    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-bc67f49fb-pmswb" podStartSLOduration=33.6214323 podStartE2EDuration="33.6214323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:02.619865413 +0000 UTC m=+109.991458671" watchObservedRunningTime="2026-07-20 17:50:02.6214323 +0000 UTC m=+109.993025568"
Jul 20 17:50:02.736944 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:02.736917    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:50:02.739458 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:02.739437    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:50:02.776251 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:02.776200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:02.874955 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:02.874921    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:03.432865 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.432821    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-q8stw"]
Jul 20 17:50:03.435011 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.434991    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c469db766-cqmxh"]
Jul 20 17:50:03.435143 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.435130    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-q8stw"
Jul 20 17:50:03.437563 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.437544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.444263 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.444211    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7gmzv\""
Jul 20 17:50:03.444806 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.444786    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 17:50:03.445972 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.445955    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 17:50:03.446055 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.445960    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 17:50:03.446233 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.446215    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 17:50:03.446332 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.446259    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 17:50:03.446486 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.446470    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 17:50:03.447421 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.447384    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c469db766-cqmxh"]
Jul 20 17:50:03.452718 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.452702    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wlkzl\""
Jul 20 17:50:03.459304 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.459281    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-q8stw"]
Jul 20 17:50:03.463839 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.463820    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 17:50:03.533689 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.533650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2tl9\" (UniqueName: \"kubernetes.io/projected/72bac6e8-fe5f-4188-b3c3-e1d95fe44337-kube-api-access-t2tl9\") pod \"downloads-5bc67dcd46-q8stw\" (UID: \"72bac6e8-fe5f-4188-b3c3-e1d95fe44337\") " pod="openshift-console/downloads-5bc67dcd46-q8stw"
Jul 20 17:50:03.533857 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.533718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-oauth-config\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.533857 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.533768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-serving-cert\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.533857 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.533786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-console-config\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.533857 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.533812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-oauth-serving-cert\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.533857 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.533853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqsrt\" (UniqueName: \"kubernetes.io/projected/03f59727-57e4-4731-a041-a47faf1294e0-kube-api-access-qqsrt\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.534078 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.533953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-service-ca\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.579935 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.579910    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:50:03.581450 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.581424    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-bc67f49fb-pmswb"
Jul 20 17:50:03.634804 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.634771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-oauth-config\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.634997 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.634822    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-serving-cert\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.634997 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.634848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-console-config\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.634997 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.634870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-oauth-serving-cert\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.635175 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.635001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqsrt\" (UniqueName: \"kubernetes.io/projected/03f59727-57e4-4731-a041-a47faf1294e0-kube-api-access-qqsrt\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.635175 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.635083    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-service-ca\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.635175 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.635117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2tl9\" (UniqueName: \"kubernetes.io/projected/72bac6e8-fe5f-4188-b3c3-e1d95fe44337-kube-api-access-t2tl9\") pod \"downloads-5bc67dcd46-q8stw\" (UID: \"72bac6e8-fe5f-4188-b3c3-e1d95fe44337\") " pod="openshift-console/downloads-5bc67dcd46-q8stw"
Jul 20 17:50:03.635634 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.635614    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-oauth-serving-cert\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.635634 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.635633    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-console-config\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.635777 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.635757    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-service-ca\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.638133 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.638114    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-oauth-config\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.638250 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.638110    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-serving-cert\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.641419 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.641283    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:03.668808 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.668776    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqsrt\" (UniqueName: \"kubernetes.io/projected/03f59727-57e4-4731-a041-a47faf1294e0-kube-api-access-qqsrt\") pod \"console-c469db766-cqmxh\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") " pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.675782 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.675753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2tl9\" (UniqueName: \"kubernetes.io/projected/72bac6e8-fe5f-4188-b3c3-e1d95fe44337-kube-api-access-t2tl9\") pod \"downloads-5bc67dcd46-q8stw\" (UID: \"72bac6e8-fe5f-4188-b3c3-e1d95fe44337\") " pod="openshift-console/downloads-5bc67dcd46-q8stw"
Jul 20 17:50:03.744609 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.744576    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-q8stw"
Jul 20 17:50:03.750430 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.750331    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:03.864824 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.864783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:03.973766 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.973299    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-q8stw"]
Jul 20 17:50:03.973766 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:03.973429    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c469db766-cqmxh"]
Jul 20 17:50:03.978015 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:03.977984    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f59727_57e4_4731_a041_a47faf1294e0.slice/crio-18ab1992131d3a5077303f7d880dd61c7088c40ff553fd039931b49b48aedc05 WatchSource:0}: Error finding container 18ab1992131d3a5077303f7d880dd61c7088c40ff553fd039931b49b48aedc05: Status 404 returned error can't find the container with id 18ab1992131d3a5077303f7d880dd61c7088c40ff553fd039931b49b48aedc05
Jul 20 17:50:03.978265 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:03.978243    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bac6e8_fe5f_4188_b3c3_e1d95fe44337.slice/crio-7c48195899b85a239686ec42127dc999901141794b4a0b9f8fd9075f5e44e69e WatchSource:0}: Error finding container 7c48195899b85a239686ec42127dc999901141794b4a0b9f8fd9075f5e44e69e: Status 404 returned error can't find the container with id 7c48195899b85a239686ec42127dc999901141794b4a0b9f8fd9075f5e44e69e
Jul 20 17:50:04.553717 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:04.553679    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bcffb"
Jul 20 17:50:04.584183 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:04.584155    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c469db766-cqmxh" event={"ID":"03f59727-57e4-4731-a041-a47faf1294e0","Type":"ContainerStarted","Data":"18ab1992131d3a5077303f7d880dd61c7088c40ff553fd039931b49b48aedc05"}
Jul 20 17:50:04.585311 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:04.585241    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-q8stw" event={"ID":"72bac6e8-fe5f-4188-b3c3-e1d95fe44337","Type":"ContainerStarted","Data":"7c48195899b85a239686ec42127dc999901141794b4a0b9f8fd9075f5e44e69e"}
Jul 20 17:50:04.972540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:04.972492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:05.095689 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.095592    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:05.247287 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.247039    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2"]
Jul 20 17:50:05.249484 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.249459    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2"
Jul 20 17:50:05.254470 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.254443    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:05.255204 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.255182    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lvgzn\""
Jul 20 17:50:05.255283 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.255224    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 20 17:50:05.267829 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.267748    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2"]
Jul 20 17:50:05.350273 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.350238    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abb47825-9ddd-4164-af61-e0026f384828-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-s4vp2\" (UID: \"abb47825-9ddd-4164-af61-e0026f384828\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2"
Jul 20 17:50:05.450884 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.450849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abb47825-9ddd-4164-af61-e0026f384828-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-s4vp2\" (UID: \"abb47825-9ddd-4164-af61-e0026f384828\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2"
Jul 20 17:50:05.451078 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:50:05.451054    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 20 17:50:05.451152 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:50:05.451121    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abb47825-9ddd-4164-af61-e0026f384828-tls-certificates podName:abb47825-9ddd-4164-af61-e0026f384828 nodeName:}" failed. No retries permitted until 2026-07-20 17:50:05.951102802 +0000 UTC m=+113.322696042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/abb47825-9ddd-4164-af61-e0026f384828-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-s4vp2" (UID: "abb47825-9ddd-4164-af61-e0026f384828") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 20 17:50:05.591210 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.591164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f" event={"ID":"19cb63a8-6e43-4cde-8074-f78547077262","Type":"ContainerStarted","Data":"7f4304889b7b7838768c671a61ed7bd40a1976010589f1e8e95df1341f679386"}
Jul 20 17:50:05.607466 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.607385    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:05.628806 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.628746    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-c4f4f" podStartSLOduration=34.311979123 podStartE2EDuration="36.62872397s" totalImagesPullingTime="2.316744847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:05.628325074 +0000 UTC m=+112.999918334" watchObservedRunningTime="2026-07-20 17:50:05.62872397 +0000 UTC m=+113.000317231"
Jul 20 17:50:05.723894 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.723857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:05.827019 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.826983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:05.956128 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.956038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abb47825-9ddd-4164-af61-e0026f384828-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-s4vp2\" (UID: \"abb47825-9ddd-4164-af61-e0026f384828\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2"
Jul 20 17:50:05.959105 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:05.959078    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/abb47825-9ddd-4164-af61-e0026f384828-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-s4vp2\" (UID: \"abb47825-9ddd-4164-af61-e0026f384828\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2"
Jul 20 17:50:06.161765 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:06.161727    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2"
Jul 20 17:50:06.184472 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:06.184361    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:06.260775 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:06.258880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:50:06.261989 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:06.261718    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/586d71e8-311f-4934-ac72-c6fd66d24b98-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2p5q8\" (UID: \"586d71e8-311f-4934-ac72-c6fd66d24b98\") " pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:50:06.288667 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:06.288583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:06.321884 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:06.321854    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2"]
Jul 20 17:50:06.549128 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:06.549036    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2p5q8"
Jul 20 17:50:07.442708 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:07.442668    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb47825_9ddd_4164_af61_e0026f384828.slice/crio-f8605ea5c9ef00be699d631e6c84acc28ae80434fb3c1a0aa04f7beeef87a6df WatchSource:0}: Error finding container f8605ea5c9ef00be699d631e6c84acc28ae80434fb3c1a0aa04f7beeef87a6df: Status 404 returned error can't find the container with id f8605ea5c9ef00be699d631e6c84acc28ae80434fb3c1a0aa04f7beeef87a6df
Jul 20 17:50:07.601136 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:07.601096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c469db766-cqmxh" event={"ID":"03f59727-57e4-4731-a041-a47faf1294e0","Type":"ContainerStarted","Data":"76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85"}
Jul 20 17:50:07.606706 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:07.603011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2" event={"ID":"abb47825-9ddd-4164-af61-e0026f384828","Type":"ContainerStarted","Data":"f8605ea5c9ef00be699d631e6c84acc28ae80434fb3c1a0aa04f7beeef87a6df"}
Jul 20 17:50:07.615969 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:07.615940    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2p5q8"]
Jul 20 17:50:07.620410 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:07.620370    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586d71e8_311f_4934_ac72_c6fd66d24b98.slice/crio-085d28149cc2f53ac3886b17548c69cb00527239cdd60927e5fbf3f55d54660c WatchSource:0}: Error finding container 085d28149cc2f53ac3886b17548c69cb00527239cdd60927e5fbf3f55d54660c: Status 404 returned error can't find the container with id 085d28149cc2f53ac3886b17548c69cb00527239cdd60927e5fbf3f55d54660c
Jul 20 17:50:07.640616 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:07.640561    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c469db766-cqmxh" podStartSLOduration=1.1377383110000001 podStartE2EDuration="4.640539226s" totalImagesPullingTime="3.502800915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:07.637846124 +0000 UTC m=+115.009439375" watchObservedRunningTime="2026-07-20 17:50:07.640539226 +0000 UTC m=+115.012132462"
Jul 20 17:50:08.610449 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:08.610386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2p5q8" event={"ID":"586d71e8-311f-4934-ac72-c6fd66d24b98","Type":"ContainerStarted","Data":"085d28149cc2f53ac3886b17548c69cb00527239cdd60927e5fbf3f55d54660c"}
Jul 20 17:50:09.617423 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:09.617358    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2" event={"ID":"abb47825-9ddd-4164-af61-e0026f384828","Type":"ContainerStarted","Data":"2e93d20374a80d1c5e9726cefd26e32ff27d52e73c8d528c2bc2b62c08415eef"}
Jul 20 17:50:09.617886 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:09.617679    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2"
Jul 20 17:50:09.623410 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:09.623377    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2"
Jul 20 17:50:09.639862 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:09.639809    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-s4vp2" podStartSLOduration=3.253270075 podStartE2EDuration="4.639789424s" totalImagesPullingTime="1.386519349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:09.638378281 +0000 UTC m=+117.009971541" watchObservedRunningTime="2026-07-20 17:50:09.639789424 +0000 UTC m=+117.011382682"
Jul 20 17:50:10.316968 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.316832    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:10.323061 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.322247    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b4df9cd74-ts77l"]
Jul 20 17:50:10.324786 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.324763    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.337169 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.337147    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 17:50:10.346741 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.346666    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b4df9cd74-ts77l"]
Jul 20 17:50:10.493415 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.493347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-oauth-config\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.493640 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.493429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zknkf\" (UniqueName: \"kubernetes.io/projected/fe942fca-a8e8-4573-8929-1c99d6389e6a-kube-api-access-zknkf\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.493640 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.493474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-trusted-ca-bundle\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.493640 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.493504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-serving-cert\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.493640 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.493533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-oauth-serving-cert\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.493640 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.493549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-config\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.493640 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.493601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-service-ca\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.583085 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.582997    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:10.593940 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.593909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-oauth-serving-cert\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.593940 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.593946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-config\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.594157 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.593982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-service-ca\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.594157 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.594020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-oauth-config\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.594157 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.594058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zknkf\" (UniqueName: \"kubernetes.io/projected/fe942fca-a8e8-4573-8929-1c99d6389e6a-kube-api-access-zknkf\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.594157 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.594103    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-trusted-ca-bundle\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.594157 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.594132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-serving-cert\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.594563 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.594493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-oauth-serving-cert\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.594716 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.594694    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-config\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.595900 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.595120    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-service-ca\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.595900 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.595559    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-trusted-ca-bundle\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.597937 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.597793    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-oauth-config\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.598256 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.598233    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-serving-cert\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.618262 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.618231    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zknkf\" (UniqueName: \"kubernetes.io/projected/fe942fca-a8e8-4573-8929-1c99d6389e6a-kube-api-access-zknkf\") pod \"console-6b4df9cd74-ts77l\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") " pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.638002 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.637810    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:10.861974 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:10.861947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:11.061253 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:11.061218    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:11.177814 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:11.177678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:11.473469 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:11.473373    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:11.574117 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:11.574077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:12.837433 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:12.837382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:12.909799 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:12.909724    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:13.450067 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:13.450029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:13.550279 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:13.550242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:13.683903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:13.683811    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b4df9cd74-ts77l"]
Jul 20 17:50:13.688046 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:13.688013    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe942fca_a8e8_4573_8929_1c99d6389e6a.slice/crio-ed1c2b7e9aa024bbd2184a7d71c2558eaaef1372542e714498dd5192984c8a91 WatchSource:0}: Error finding container ed1c2b7e9aa024bbd2184a7d71c2558eaaef1372542e714498dd5192984c8a91: Status 404 returned error can't find the container with id ed1c2b7e9aa024bbd2184a7d71c2558eaaef1372542e714498dd5192984c8a91
Jul 20 17:50:13.751159 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:13.751121    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:13.751279 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:13.751184    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:13.757941 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:13.757920    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:14.647491 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:14.647288    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4df9cd74-ts77l" event={"ID":"fe942fca-a8e8-4573-8929-1c99d6389e6a","Type":"ContainerStarted","Data":"5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178"}
Jul 20 17:50:14.647943 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:14.647615    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4df9cd74-ts77l" event={"ID":"fe942fca-a8e8-4573-8929-1c99d6389e6a","Type":"ContainerStarted","Data":"ed1c2b7e9aa024bbd2184a7d71c2558eaaef1372542e714498dd5192984c8a91"}
Jul 20 17:50:14.649451 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:14.649423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2p5q8" event={"ID":"586d71e8-311f-4934-ac72-c6fd66d24b98","Type":"ContainerStarted","Data":"a5c938e28aa9a1704110158f62a6057eef2b0ef3f32fbbf0b8fce0ecdbb43e71"}
Jul 20 17:50:14.654535 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:14.654511    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:14.702899 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:14.702831    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b4df9cd74-ts77l" podStartSLOduration=4.702807747 podStartE2EDuration="4.702807747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:14.685314174 +0000 UTC m=+122.056907433" watchObservedRunningTime="2026-07-20 17:50:14.702807747 +0000 UTC m=+122.074401008"
Jul 20 17:50:15.781440 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:15.781380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:16.362249 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.362216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:16.791336 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.791150    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:16.853619 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.853585    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-mgftb"]
Jul 20 17:50:16.868031 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.868005    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:16.886454 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.886247    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-kgkkp\""
Jul 20 17:50:16.886454 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.886263    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 20 17:50:16.895685 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.895659    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 17:50:16.897107 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.897087    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 20 17:50:16.908163 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.907958    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 20 17:50:16.927861 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.927830    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-mgftb"]
Jul 20 17:50:16.943782 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.943748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:16.943969 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.943800    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:16.943969 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.943856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:16.943969 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.943937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2d708f8d-f604-4bce-9f0e-f67a102da9f6-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:16.944133 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.944005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-979hs\" (UniqueName: \"kubernetes.io/projected/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-api-access-979hs\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:16.944133 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:16.944039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d708f8d-f604-4bce-9f0e-f67a102da9f6-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.045642 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.045548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.045642 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.045621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2d708f8d-f604-4bce-9f0e-f67a102da9f6-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.045856 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.045703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-979hs\" (UniqueName: \"kubernetes.io/projected/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-api-access-979hs\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.045856 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.045743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d708f8d-f604-4bce-9f0e-f67a102da9f6-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.045856 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.045775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.045856 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.045806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.046117 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.046058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2d708f8d-f604-4bce-9f0e-f67a102da9f6-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.047282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.046346    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.047282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.046679    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d708f8d-f604-4bce-9f0e-f67a102da9f6-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.048839 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.048772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.049801 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.049778    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.068514 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.068487    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qvphf"]
Jul 20 17:50:17.074711 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.074686    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.084210 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.084187    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 17:50:17.084742 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.084665    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 17:50:17.084742 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.084729    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2dmjq\""
Jul 20 17:50:17.084903 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.084771    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 17:50:17.087328 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.087305    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-979hs\" (UniqueName: \"kubernetes.io/projected/2d708f8d-f604-4bce-9f0e-f67a102da9f6-kube-api-access-979hs\") pod \"kube-state-metrics-56c5594674-mgftb\" (UID: \"2d708f8d-f604-4bce-9f0e-f67a102da9f6\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.146352 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.146313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-accelerators-collector-config\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.146528 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.146368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-wtmp\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.146528 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.146405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-sys\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.146528 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.146432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-tls\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.146528 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.146459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-metrics-client-ca\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.146528 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.146475    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz4kt\" (UniqueName: \"kubernetes.io/projected/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-kube-api-access-kz4kt\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.146741 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.146566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-root\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.146741 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.146605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-textfile\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.146741 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.146623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.178805 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.178761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb"
Jul 20 17:50:17.247028 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.246990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-metrics-client-ca\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247028 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz4kt\" (UniqueName: \"kubernetes.io/projected/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-kube-api-access-kz4kt\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247266 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-root\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247327 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-textfile\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247327 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247458 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-accelerators-collector-config\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247458 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247419    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-root\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247458 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-wtmp\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247608 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-sys\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247608 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-tls\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247608 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247525    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-textfile\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247608 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-sys\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247798 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247667    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-metrics-client-ca\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247798 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247712    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-wtmp\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.247901 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.247879    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-accelerators-collector-config\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.249982 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.249960    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.250104 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.250082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-node-exporter-tls\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.382069 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.382033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:17.412209 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.412182    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz4kt\" (UniqueName: \"kubernetes.io/projected/e0da40e6-0634-4a7c-b7a8-14af1bd67e70-kube-api-access-kz4kt\") pod \"node-exporter-qvphf\" (UID: \"e0da40e6-0634-4a7c-b7a8-14af1bd67e70\") " pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.686775 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.686690    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qvphf"
Jul 20 17:50:17.698491 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:17.698373    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:18.005761 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.005686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:18.247203 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.247166    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:18.587852 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.587820    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 17:50:18.590894 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.590869    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.606548 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.606500    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 17:50:18.613214 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.613190    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 17:50:18.614919 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.614903    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 17:50:18.615032 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.614904    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 17:50:18.615261 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.615236    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 17:50:18.616369 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.616349    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 17:50:18.616862 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.616843    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 17:50:18.617004 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.616985    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 17:50:18.618167 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.618143    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 17:50:18.618239 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.618197    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w7sr6\""
Jul 20 17:50:18.660935 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.660904    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 17:50:18.661343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-web-config\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661545 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661369    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661545 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661545 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661545 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661672 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-config-out\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661672 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661672 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661672 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661672 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661877 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.661877 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.661776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx8sg\" (UniqueName: \"kubernetes.io/projected/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-kube-api-access-vx8sg\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.751381 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.751338    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:18.763199 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763165    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763357 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763357 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763357 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763274    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763357 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx8sg\" (UniqueName: \"kubernetes.io/projected/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-kube-api-access-vx8sg\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763596 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763596 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763516    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-web-config\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763596 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763596 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763785 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763785 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763785 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-config-out\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.763785 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.763690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.764578 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.764548    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.764688 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.764596    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.765168 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.765144    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.767430 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.767035    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.767679 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.767605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.768097 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.768058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.768229 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.768184    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.768545 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.768478    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-web-config\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.768646 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.768596    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.769183 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.769165    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-config-out\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.769290 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.769268    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.770586 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.770547    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.792268 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.792242    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx8sg\" (UniqueName: \"kubernetes.io/projected/4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93-kube-api-access-vx8sg\") pod \"alertmanager-main-0\" (UID: \"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:18.903134 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:18.903054    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 17:50:19.036231 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:19.036186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:20.360873 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.360833    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7847db549c-kdkzx"]
Jul 20 17:50:20.364060 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.364038    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.374095 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.374073    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 20 17:50:20.374202 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.374178    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 20 17:50:20.374279 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.374185    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qxbrr\""
Jul 20 17:50:20.374547 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.374531    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-amamm51293sv\""
Jul 20 17:50:20.374638 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.374572    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 20 17:50:20.374700 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.374636    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 20 17:50:20.374802 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.374785    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 20 17:50:20.378516 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.378486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-tls\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.378632 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.378523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-grpc-tls\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.378632 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.378563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.378632 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.378593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.378806 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.378657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b675c70a-ba7e-42a9-a65a-9c93b28207cf-metrics-client-ca\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.378806 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.378709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.378806 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.378751    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flnfl\" (UniqueName: \"kubernetes.io/projected/b675c70a-ba7e-42a9-a65a-9c93b28207cf-kube-api-access-flnfl\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.378931 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.378785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.383758 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.383669    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7847db549c-kdkzx"]
Jul 20 17:50:20.479575 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.479541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-tls\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.479575 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.479580    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-grpc-tls\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.479797 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.479621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.479797 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.479651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.479797 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.479709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b675c70a-ba7e-42a9-a65a-9c93b28207cf-metrics-client-ca\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.479797 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.479728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.479797 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.479757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flnfl\" (UniqueName: \"kubernetes.io/projected/b675c70a-ba7e-42a9-a65a-9c93b28207cf-kube-api-access-flnfl\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.479988 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.479803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.480950 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.480844    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b675c70a-ba7e-42a9-a65a-9c93b28207cf-metrics-client-ca\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.482839 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.482789    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-tls\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.482953 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.482930    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.483019 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.482996    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.483235 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.483211    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.483684 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.483665    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.483879 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.483857    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b675c70a-ba7e-42a9-a65a-9c93b28207cf-secret-grpc-tls\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.496893 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.496867    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flnfl\" (UniqueName: \"kubernetes.io/projected/b675c70a-ba7e-42a9-a65a-9c93b28207cf-kube-api-access-flnfl\") pod \"thanos-querier-7847db549c-kdkzx\" (UID: \"b675c70a-ba7e-42a9-a65a-9c93b28207cf\") " pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.638044 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.637963    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:20.638044 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.638042    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:20.643420 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.643379    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:20.676382 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.676295    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:20.683162 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.683136    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:20.961536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:20.961456    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c469db766-cqmxh"]
Jul 20 17:50:21.081624 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.081585    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:21.120892 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.120862    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"]
Jul 20 17:50:21.123214 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.123186    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"
Jul 20 17:50:21.127477 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.127453    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hthv4\""
Jul 20 17:50:21.127898 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.127884    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 20 17:50:21.154564 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.154525    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"]
Jul 20 17:50:21.185166 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.185138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqcr\" (UniqueName: \"kubernetes.io/projected/2a664fed-c6ce-40b2-8ad0-4d0275ad56c2-kube-api-access-grqcr\") pod \"monitoring-plugin-7b7b7bc8bf-tljgm\" (UID: \"2a664fed-c6ce-40b2-8ad0-4d0275ad56c2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"
Jul 20 17:50:21.185337 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.185200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a664fed-c6ce-40b2-8ad0-4d0275ad56c2-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-tljgm\" (UID: \"2a664fed-c6ce-40b2-8ad0-4d0275ad56c2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"
Jul 20 17:50:21.273330 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.273243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:21.286452 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.286421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a664fed-c6ce-40b2-8ad0-4d0275ad56c2-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-tljgm\" (UID: \"2a664fed-c6ce-40b2-8ad0-4d0275ad56c2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"
Jul 20 17:50:21.286583 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.286553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grqcr\" (UniqueName: \"kubernetes.io/projected/2a664fed-c6ce-40b2-8ad0-4d0275ad56c2-kube-api-access-grqcr\") pod \"monitoring-plugin-7b7b7bc8bf-tljgm\" (UID: \"2a664fed-c6ce-40b2-8ad0-4d0275ad56c2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"
Jul 20 17:50:21.289325 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.289302    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a664fed-c6ce-40b2-8ad0-4d0275ad56c2-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-tljgm\" (UID: \"2a664fed-c6ce-40b2-8ad0-4d0275ad56c2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"
Jul 20 17:50:21.311041 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.311011    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d758b7874-cd4gk"]
Jul 20 17:50:21.313428 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.313377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.314375 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.314354    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqcr\" (UniqueName: \"kubernetes.io/projected/2a664fed-c6ce-40b2-8ad0-4d0275ad56c2-kube-api-access-grqcr\") pod \"monitoring-plugin-7b7b7bc8bf-tljgm\" (UID: \"2a664fed-c6ce-40b2-8ad0-4d0275ad56c2\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"
Jul 20 17:50:21.339015 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.338984    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d758b7874-cd4gk"]
Jul 20 17:50:21.387133 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.387101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-oauth-config\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.387520 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.387179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkwbn\" (UniqueName: \"kubernetes.io/projected/727359bc-f43d-44e6-9bf9-34864c608ef2-kube-api-access-fkwbn\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.387520 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.387247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-oauth-serving-cert\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.387520 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.387302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-service-ca\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.387520 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.387333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-serving-cert\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.387520 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.387372    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-console-config\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.387520 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.387410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-trusted-ca-bundle\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.434857 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.434825    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"
Jul 20 17:50:21.487991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.487958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-console-config\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.487991 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.488002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-trusted-ca-bundle\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.488222 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.488066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-oauth-config\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.488222 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.488124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkwbn\" (UniqueName: \"kubernetes.io/projected/727359bc-f43d-44e6-9bf9-34864c608ef2-kube-api-access-fkwbn\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.488222 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.488158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-oauth-serving-cert\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.488222 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.488188    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-service-ca\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.488222 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.488217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-serving-cert\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.489596 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.488876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-console-config\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.489596 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.489117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-trusted-ca-bundle\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.489596 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.489117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-oauth-serving-cert\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.489772 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.489605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-service-ca\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.490972 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.490945    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-oauth-config\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.491276 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.491254    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-serving-cert\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.528509 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.528438    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkwbn\" (UniqueName: \"kubernetes.io/projected/727359bc-f43d-44e6-9bf9-34864c608ef2-kube-api-access-fkwbn\") pod \"console-6d758b7874-cd4gk\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") " pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.554579 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.554550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:21.633858 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.633820    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:21.711257 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.711220    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:21.975428 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:21.975371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:22.034188 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.034153    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"]
Jul 20 17:50:22.036919 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.036889    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.044217 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.044193    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 17:50:22.066178 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.066149    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 17:50:22.066455 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.066435    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 17:50:22.075632 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.075600    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 17:50:22.077702 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.077675    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 17:50:22.089964 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.089940    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"]
Jul 20 17:50:22.094413 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.094361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-telemeter-client-tls\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.094494 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.094449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf96v\" (UniqueName: \"kubernetes.io/projected/4e45d423-9b25-436f-96ea-f4af702c8974-kube-api-access-sf96v\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.094555 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.094495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.094555 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.094515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e45d423-9b25-436f-96ea-f4af702c8974-metrics-client-ca\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.094664 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.094602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-secret-telemeter-client\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.094664 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.094637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e45d423-9b25-436f-96ea-f4af702c8974-serving-certs-ca-bundle\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.094762 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.094677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e45d423-9b25-436f-96ea-f4af702c8974-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.094762 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.094732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-federate-client-tls\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.098790 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.098770    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85f5756564-pjq4n"]
Jul 20 17:50:22.101246 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.101224    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.121137 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.121108    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qgjd7\""
Jul 20 17:50:22.121440 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.121379    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1jcncv7er5lge\""
Jul 20 17:50:22.121553 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.121125    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 20 17:50:22.121635 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.121208    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 17:50:22.121708 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.121383    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 20 17:50:22.121708 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.121125    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 20 17:50:22.122206 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.122183    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 17:50:22.122477 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.122457    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jskth\""
Jul 20 17:50:22.123386 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.123364    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85f5756564-pjq4n"]
Jul 20 17:50:22.196073 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5ea2492d-d440-4127-87a8-8335f8ddf63d-secret-metrics-server-client-certs\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.196259 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.196259 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ea2492d-d440-4127-87a8-8335f8ddf63d-client-ca-bundle\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.196259 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e45d423-9b25-436f-96ea-f4af702c8974-metrics-client-ca\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.196259 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-secret-telemeter-client\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.196500 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196271    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea2492d-d440-4127-87a8-8335f8ddf63d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.196500 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e45d423-9b25-436f-96ea-f4af702c8974-serving-certs-ca-bundle\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.196500 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5ea2492d-d440-4127-87a8-8335f8ddf63d-audit-log\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.196500 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e45d423-9b25-436f-96ea-f4af702c8974-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.196500 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-federate-client-tls\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.196500 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-telemeter-client-tls\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.196777 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5ea2492d-d440-4127-87a8-8335f8ddf63d-secret-metrics-server-tls\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.196777 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf96v\" (UniqueName: \"kubernetes.io/projected/4e45d423-9b25-436f-96ea-f4af702c8974-kube-api-access-sf96v\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.196777 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5ea2492d-d440-4127-87a8-8335f8ddf63d-metrics-server-audit-profiles\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.196777 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.196651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz25r\" (UniqueName: \"kubernetes.io/projected/5ea2492d-d440-4127-87a8-8335f8ddf63d-kube-api-access-nz25r\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.197253 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.197122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e45d423-9b25-436f-96ea-f4af702c8974-metrics-client-ca\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.197491 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.197466    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e45d423-9b25-436f-96ea-f4af702c8974-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.197827 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.197800    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e45d423-9b25-436f-96ea-f4af702c8974-serving-certs-ca-bundle\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.199119 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.199087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.199472 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.199454    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-secret-telemeter-client\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.199552 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.199538    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-telemeter-client-tls\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.199844 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.199825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e45d423-9b25-436f-96ea-f4af702c8974-federate-client-tls\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.239007 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.238946    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf96v\" (UniqueName: \"kubernetes.io/projected/4e45d423-9b25-436f-96ea-f4af702c8974-kube-api-access-sf96v\") pod \"telemeter-client-55d9d8dcd4-4bqb6\" (UID: \"4e45d423-9b25-436f-96ea-f4af702c8974\") " pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.257779 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.257744    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:22.297579 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.297546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5ea2492d-d440-4127-87a8-8335f8ddf63d-secret-metrics-server-client-certs\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.297746 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.297595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ea2492d-d440-4127-87a8-8335f8ddf63d-client-ca-bundle\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.297746 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.297637    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea2492d-d440-4127-87a8-8335f8ddf63d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.297746 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.297663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5ea2492d-d440-4127-87a8-8335f8ddf63d-audit-log\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.297907 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.297766    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5ea2492d-d440-4127-87a8-8335f8ddf63d-secret-metrics-server-tls\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.297907 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.297801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5ea2492d-d440-4127-87a8-8335f8ddf63d-metrics-server-audit-profiles\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.297907 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.297829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz25r\" (UniqueName: \"kubernetes.io/projected/5ea2492d-d440-4127-87a8-8335f8ddf63d-kube-api-access-nz25r\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.298195 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.298142    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5ea2492d-d440-4127-87a8-8335f8ddf63d-audit-log\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.298532 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.298485    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ea2492d-d440-4127-87a8-8335f8ddf63d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.298999 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.298976    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5ea2492d-d440-4127-87a8-8335f8ddf63d-metrics-server-audit-profiles\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.300836 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.300810    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5ea2492d-d440-4127-87a8-8335f8ddf63d-client-ca-bundle\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.300963 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.300946    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5ea2492d-d440-4127-87a8-8335f8ddf63d-secret-metrics-server-client-certs\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.301021 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.300980    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5ea2492d-d440-4127-87a8-8335f8ddf63d-secret-metrics-server-tls\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.326070 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.326051    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz25r\" (UniqueName: \"kubernetes.io/projected/5ea2492d-d440-4127-87a8-8335f8ddf63d-kube-api-access-nz25r\") pod \"metrics-server-85f5756564-pjq4n\" (UID: \"5ea2492d-d440-4127-87a8-8335f8ddf63d\") " pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.347883 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.347848    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"
Jul 20 17:50:22.411554 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.411522    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:22.902983 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.902950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:50:22.905627 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:22.905602    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10018892-ce37-41d3-8c3f-2e43682209fc-metrics-certs\") pod \"network-metrics-daemon-vvz9s\" (UID: \"10018892-ce37-41d3-8c3f-2e43682209fc\") " pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:50:23.000803 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:23.000767    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mjfj5\""
Jul 20 17:50:23.008312 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:23.008285    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vvz9s"
Jul 20 17:50:23.905665 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:23.905627    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:24.020631 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:24.020593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:25.141888 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:25.141852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:25.269955 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:25.269914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:25.703275 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:25.703192    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qvphf" event={"ID":"e0da40e6-0634-4a7c-b7a8-14af1bd67e70","Type":"ContainerStarted","Data":"218cac1ab4dd978767fb48e34d2c01f575bf5a18f84bbf67af8c542eb2925731"}
Jul 20 17:50:25.978851 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:25.978442    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-mgftb"]
Jul 20 17:50:25.982548 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:25.982464    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d708f8d_f604_4bce_9f0e_f67a102da9f6.slice/crio-4024c41a6d0fa3ac9e3fa0f1a64492fcf7061eff893112c501df61aaad552d63 WatchSource:0}: Error finding container 4024c41a6d0fa3ac9e3fa0f1a64492fcf7061eff893112c501df61aaad552d63: Status 404 returned error can't find the container with id 4024c41a6d0fa3ac9e3fa0f1a64492fcf7061eff893112c501df61aaad552d63
Jul 20 17:50:26.021182 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.021033    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d758b7874-cd4gk"]
Jul 20 17:50:26.023735 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:26.023669    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727359bc_f43d_44e6_9bf9_34864c608ef2.slice/crio-024373b28111572dd813b14261ac427e1ceef44e0498d58423fa616db03e0333 WatchSource:0}: Error finding container 024373b28111572dd813b14261ac427e1ceef44e0498d58423fa616db03e0333: Status 404 returned error can't find the container with id 024373b28111572dd813b14261ac427e1ceef44e0498d58423fa616db03e0333
Jul 20 17:50:26.043010 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.042928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:26.068712 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.068615    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 17:50:26.258204 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.258076    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"]
Jul 20 17:50:26.266649 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:26.266324    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a664fed_c6ce_40b2_8ad0_4d0275ad56c2.slice/crio-4be52d394641253c13daddb8fa9d3285ff31eb256b5864a8e8c77658a632f99c WatchSource:0}: Error finding container 4be52d394641253c13daddb8fa9d3285ff31eb256b5864a8e8c77658a632f99c: Status 404 returned error can't find the container with id 4be52d394641253c13daddb8fa9d3285ff31eb256b5864a8e8c77658a632f99c
Jul 20 17:50:26.267003 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:26.266971    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb675c70a_ba7e_42a9_a65a_9c93b28207cf.slice/crio-1b681386cd0533b9c4274e3456c8766479abee4fa709d2932685bace7dfbb666 WatchSource:0}: Error finding container 1b681386cd0533b9c4274e3456c8766479abee4fa709d2932685bace7dfbb666: Status 404 returned error can't find the container with id 1b681386cd0533b9c4274e3456c8766479abee4fa709d2932685bace7dfbb666
Jul 20 17:50:26.268853 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.268828    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7847db549c-kdkzx"]
Jul 20 17:50:26.271972 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.271712    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vvz9s"]
Jul 20 17:50:26.273319 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:26.272827    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e45d423_9b25_436f_96ea_f4af702c8974.slice/crio-7b0f4bb3da685c6c141c8e3d850fa89e3b33d102f6affd7b83317d3ea2d0d275 WatchSource:0}: Error finding container 7b0f4bb3da685c6c141c8e3d850fa89e3b33d102f6affd7b83317d3ea2d0d275: Status 404 returned error can't find the container with id 7b0f4bb3da685c6c141c8e3d850fa89e3b33d102f6affd7b83317d3ea2d0d275
Jul 20 17:50:26.275575 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.275444    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6"]
Jul 20 17:50:26.276711 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.276406    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85f5756564-pjq4n"]
Jul 20 17:50:26.357319 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.357200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:26.710681 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.710596    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6" event={"ID":"4e45d423-9b25-436f-96ea-f4af702c8974","Type":"ContainerStarted","Data":"7b0f4bb3da685c6c141c8e3d850fa89e3b33d102f6affd7b83317d3ea2d0d275"}
Jul 20 17:50:26.712787 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.712713    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vvz9s" event={"ID":"10018892-ce37-41d3-8c3f-2e43682209fc","Type":"ContainerStarted","Data":"75ad99bdba96845431fb65450bf6a673a01fc7abb4f7a9c43204c751dda39e95"}
Jul 20 17:50:26.714795 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.714744    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx" event={"ID":"b675c70a-ba7e-42a9-a65a-9c93b28207cf","Type":"ContainerStarted","Data":"1b681386cd0533b9c4274e3456c8766479abee4fa709d2932685bace7dfbb666"}
Jul 20 17:50:26.719717 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.719689    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2p5q8" event={"ID":"586d71e8-311f-4934-ac72-c6fd66d24b98","Type":"ContainerStarted","Data":"2d71a71ced44cd9ed01f9b22be95277c7113ff77e13083b1d2a9c8b5192b648f"}
Jul 20 17:50:26.721569 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.721502    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm" event={"ID":"2a664fed-c6ce-40b2-8ad0-4d0275ad56c2","Type":"ContainerStarted","Data":"4be52d394641253c13daddb8fa9d3285ff31eb256b5864a8e8c77658a632f99c"}
Jul 20 17:50:26.723243 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.723215    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85f5756564-pjq4n" event={"ID":"5ea2492d-d440-4127-87a8-8335f8ddf63d","Type":"ContainerStarted","Data":"d3e7fa29e3f280fc19a56293f5506eab891840c889630962326c6205fe394579"}
Jul 20 17:50:26.725718 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.725683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d758b7874-cd4gk" event={"ID":"727359bc-f43d-44e6-9bf9-34864c608ef2","Type":"ContainerStarted","Data":"d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f"}
Jul 20 17:50:26.725795 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.725739    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d758b7874-cd4gk" event={"ID":"727359bc-f43d-44e6-9bf9-34864c608ef2","Type":"ContainerStarted","Data":"024373b28111572dd813b14261ac427e1ceef44e0498d58423fa616db03e0333"}
Jul 20 17:50:26.730630 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.730569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-q8stw" event={"ID":"72bac6e8-fe5f-4188-b3c3-e1d95fe44337","Type":"ContainerStarted","Data":"db77e19b0c5de3565e49d3a5c25c8dd1f09368036c1d746b085dcc672ea8304f"}
Jul 20 17:50:26.731088 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.731065    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-q8stw"
Jul 20 17:50:26.733950 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.733925    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93","Type":"ContainerStarted","Data":"a2ebf0c60b7ffc9f0c8b83f97a60137609ac0fe9953a664ccb544e9651ec53d0"}
Jul 20 17:50:26.738029 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.738008    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb" event={"ID":"2d708f8d-f604-4bce-9f0e-f67a102da9f6","Type":"ContainerStarted","Data":"4024c41a6d0fa3ac9e3fa0f1a64492fcf7061eff893112c501df61aaad552d63"}
Jul 20 17:50:26.743150 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.743107    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-q8stw"
Jul 20 17:50:26.776893 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.776833    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-q8stw" podStartSLOduration=2.037997606 podStartE2EDuration="23.776811186s" totalImagesPullingTime="21.73881358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:26.774429077 +0000 UTC m=+134.146022333" watchObservedRunningTime="2026-07-20 17:50:26.776811186 +0000 UTC m=+134.148404436"
Jul 20 17:50:26.777639 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:26.777593    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d758b7874-cd4gk" podStartSLOduration=5.777574038 podStartE2EDuration="5.777574038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:26.751615526 +0000 UTC m=+134.123208788" watchObservedRunningTime="2026-07-20 17:50:26.777574038 +0000 UTC m=+134.149167301"
Jul 20 17:50:27.351267 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:27.351199    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:27.430876 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:27.430832    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:27.760540 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:27.760460    2562 generic.go:356] "Generic (PLEG): container finished" podID="e0da40e6-0634-4a7c-b7a8-14af1bd67e70" containerID="1a8ddaa202fdffe57ecdb82832472bf991dc3a47fee2503421e9001c8bedff06" exitCode=0
Jul 20 17:50:27.761620 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:27.761592    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qvphf" event={"ID":"e0da40e6-0634-4a7c-b7a8-14af1bd67e70","Type":"ContainerDied","Data":"1a8ddaa202fdffe57ecdb82832472bf991dc3a47fee2503421e9001c8bedff06"}
Jul 20 17:50:28.785527 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:28.785361    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qvphf" event={"ID":"e0da40e6-0634-4a7c-b7a8-14af1bd67e70","Type":"ContainerStarted","Data":"3f829ec661f0befa74f18e2e63fdb69d5e6de40b3187df77f71b32b247152e0f"}
Jul 20 17:50:28.785527 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:28.785471    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qvphf" event={"ID":"e0da40e6-0634-4a7c-b7a8-14af1bd67e70","Type":"ContainerStarted","Data":"096642806e0deb8d2c52627db7b474093121bc1704ffc5abef0a2c06dbce2f10"}
Jul 20 17:50:28.810574 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:28.808706    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qvphf" podStartSLOduration=11.312920247 podStartE2EDuration="12.808684942s" totalImagesPullingTime="1.358121552s" totalInitContainerRuntime="137.643143ms" isStatefulPod=true podCreationTimestamp="2026-07-20 17:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:28.808491929 +0000 UTC m=+136.180085190" watchObservedRunningTime="2026-07-20 17:50:28.808684942 +0000 UTC m=+136.180278182"
Jul 20 17:50:31.634590 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:31.634553    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:31.635113 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:31.634622    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:31.639741 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:31.639721    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:31.804582 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:31.804553    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:50:31.862565 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:31.862492    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b4df9cd74-ts77l"]
Jul 20 17:50:32.034541 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:32.034436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:32.137600 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:32.137490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:33.243668 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:33.243533    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:33.346735 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:33.346704    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:36.826559 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.826325    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6" event={"ID":"4e45d423-9b25-436f-96ea-f4af702c8974","Type":"ContainerStarted","Data":"983456f6555454c9db8c1a2e18174c51da955556d9ae57f33986728d04ce765c"}
Jul 20 17:50:36.826559 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.826507    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6" event={"ID":"4e45d423-9b25-436f-96ea-f4af702c8974","Type":"ContainerStarted","Data":"13404c66818a4ce977bb5b117795ef63208cc3195645c42689fba2a316bde420"}
Jul 20 17:50:36.829840 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.829809    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vvz9s" event={"ID":"10018892-ce37-41d3-8c3f-2e43682209fc","Type":"ContainerStarted","Data":"a11c6d616cc01ffdb4f4107651c4a9fa5492333fd191f8c08e09bd3a649968d5"}
Jul 20 17:50:36.829956 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.829861    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vvz9s" event={"ID":"10018892-ce37-41d3-8c3f-2e43682209fc","Type":"ContainerStarted","Data":"f31735895a1d733235685fdf4dd71ed905be94454eef855659599e1d95724d53"}
Jul 20 17:50:36.834520 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.833865    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx" event={"ID":"b675c70a-ba7e-42a9-a65a-9c93b28207cf","Type":"ContainerStarted","Data":"c2299774919251d86cae8f2516db7a5e75d1cc61907ff73d0b26b41612ea6cf5"}
Jul 20 17:50:36.834520 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.833938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx" event={"ID":"b675c70a-ba7e-42a9-a65a-9c93b28207cf","Type":"ContainerStarted","Data":"c0df00721131e07f079792780d7038f4ca5a9b801e76c511674d894e0466522e"}
Jul 20 17:50:36.837029 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.836796    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2p5q8" event={"ID":"586d71e8-311f-4934-ac72-c6fd66d24b98","Type":"ContainerStarted","Data":"99d9e8d6a25da0d65bcbde4a0940478a3c1d04da5af1ac58f803dcd20ba52a88"}
Jul 20 17:50:36.839741 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.839721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm" event={"ID":"2a664fed-c6ce-40b2-8ad0-4d0275ad56c2","Type":"ContainerStarted","Data":"c7152e38029c32e430a41f0275e4f3ccdcf55daab254fb5316147560d1309ee5"}
Jul 20 17:50:36.840519 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.840504    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"
Jul 20 17:50:36.843232 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.843205    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85f5756564-pjq4n" event={"ID":"5ea2492d-d440-4127-87a8-8335f8ddf63d","Type":"ContainerStarted","Data":"f280409fd331863dc398ea5ccbfbb2c921892bae3b22aad5f7ee2992849d6be4"}
Jul 20 17:50:36.845426 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.845221    2562 generic.go:356] "Generic (PLEG): container finished" podID="4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93" containerID="1990741d09047e6d09edf385752cdaf7c2f0394895573c7d843b9a159d602640" exitCode=0
Jul 20 17:50:36.845426 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.845295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93","Type":"ContainerDied","Data":"1990741d09047e6d09edf385752cdaf7c2f0394895573c7d843b9a159d602640"}
Jul 20 17:50:36.849522 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.849447    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb" event={"ID":"2d708f8d-f604-4bce-9f0e-f67a102da9f6","Type":"ContainerStarted","Data":"69a28a7a8a5fa8dd7f98b8d570f470ded28a3479fdb57c3db58fc68a8055c1cf"}
Jul 20 17:50:36.849522 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.849494    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb" event={"ID":"2d708f8d-f604-4bce-9f0e-f67a102da9f6","Type":"ContainerStarted","Data":"91579f7edae2980412952a7060cecc2a807e23687408086bd934f248f38d4dd6"}
Jul 20 17:50:36.850322 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.850306    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm"
Jul 20 17:50:36.866012 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.865624    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vvz9s" podStartSLOduration=133.912826164 podStartE2EDuration="2m23.8656035s" totalImagesPullingTime="9.952777336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:36.864514423 +0000 UTC m=+144.236107684" watchObservedRunningTime="2026-07-20 17:50:36.8656035 +0000 UTC m=+144.237196762"
Jul 20 17:50:36.914153 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.914107    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85f5756564-pjq4n" podStartSLOduration=4.843994342 podStartE2EDuration="14.91409072s" totalImagesPullingTime="10.070096378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:36.912708944 +0000 UTC m=+144.284302200" watchObservedRunningTime="2026-07-20 17:50:36.91409072 +0000 UTC m=+144.285683957"
Jul 20 17:50:36.984506 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:36.984450    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-tljgm" podStartSLOduration=5.895321147 podStartE2EDuration="15.984434557s" totalImagesPullingTime="10.08911341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:36.983413348 +0000 UTC m=+144.355006606" watchObservedRunningTime="2026-07-20 17:50:36.984434557 +0000 UTC m=+144.356027816"
Jul 20 17:50:37.093360 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:37.093302    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb" podStartSLOduration=10.720534651 podStartE2EDuration="21.09328008s" totalImagesPullingTime="10.372745429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:37.092539449 +0000 UTC m=+144.464132709" watchObservedRunningTime="2026-07-20 17:50:37.09328008 +0000 UTC m=+144.464873341"
Jul 20 17:50:37.143441 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:37.143371    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2p5q8" podStartSLOduration=34.658499722 podStartE2EDuration="1m3.143356125s" totalImagesPullingTime="28.484856403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 17:49:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:37.141109083 +0000 UTC m=+144.512702340" watchObservedRunningTime="2026-07-20 17:50:37.143356125 +0000 UTC m=+144.514949383"
Jul 20 17:50:37.169458 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:37.169377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:37.334149 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:37.334114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:37.857864 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:37.857814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-mgftb" event={"ID":"2d708f8d-f604-4bce-9f0e-f67a102da9f6","Type":"ContainerStarted","Data":"fbd8fe80c2b0511a3fff0931038ab3577112ee16a77c158ce2047e04b5b248ef"}
Jul 20 17:50:37.860107 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:37.860068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6" event={"ID":"4e45d423-9b25-436f-96ea-f4af702c8974","Type":"ContainerStarted","Data":"33c2815c0895b1c09d559940c89089baf84e7f0b06e824bf5ec528094a3ff3a7"}
Jul 20 17:50:37.862282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:37.862250    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx" event={"ID":"b675c70a-ba7e-42a9-a65a-9c93b28207cf","Type":"ContainerStarted","Data":"30f1365b512d7e1b303fa97400bf392e5b41b252b489cce11a7fc58452d130f8"}
Jul 20 17:50:38.616847 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.616783    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-55d9d8dcd4-4bqb6" podStartSLOduration=7.546556477 podStartE2EDuration="17.616757487s" totalImagesPullingTime="10.07020101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:37.897650874 +0000 UTC m=+145.269244156" watchObservedRunningTime="2026-07-20 17:50:38.616757487 +0000 UTC m=+145.988350727"
Jul 20 17:50:38.617977 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.617954    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d45c48558-659nz"]
Jul 20 17:50:38.641036 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.641010    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.643029 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.643005    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d45c48558-659nz"]
Jul 20 17:50:38.759686 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.759569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:38.780722 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.780695    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-oauth-config\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.780873 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.780733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-config\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.780873 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.780754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-oauth-serving-cert\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.780873 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.780781    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-trusted-ca-bundle\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.780873 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.780812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-service-ca\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.780873 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.780838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-serving-cert\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.781051 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.780888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4qtx\" (UniqueName: \"kubernetes.io/projected/c10e4515-7555-4f70-90ea-45e3eaeddb30-kube-api-access-v4qtx\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.873064 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.873038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:38.882070 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.882035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-oauth-config\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.882176 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.882073    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-config\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.882240 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.882208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-oauth-serving-cert\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.882300 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.882261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-trusted-ca-bundle\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.882300 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.882292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-service-ca\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.882434 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.882339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-serving-cert\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.882434 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.882422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4qtx\" (UniqueName: \"kubernetes.io/projected/c10e4515-7555-4f70-90ea-45e3eaeddb30-kube-api-access-v4qtx\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.882800 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.882778    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-config\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.883119 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.883096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-service-ca\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.883537 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.883503    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-trusted-ca-bundle\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.883615 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.883505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-oauth-serving-cert\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.884827 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.884803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-oauth-config\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.885113 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.885094    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-serving-cert\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.894665 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.894646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4qtx\" (UniqueName: \"kubernetes.io/projected/c10e4515-7555-4f70-90ea-45e3eaeddb30-kube-api-access-v4qtx\") pod \"console-6d45c48558-659nz\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") " pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:38.953211 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:38.953189    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:39.113735 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.113558    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d45c48558-659nz"]
Jul 20 17:50:39.226209 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:50:39.226178    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10e4515_7555_4f70_90ea_45e3eaeddb30.slice/crio-69a541f35cdb658ec13233c874252bfa3554127498af0d603adec24f5221edd2 WatchSource:0}: Error finding container 69a541f35cdb658ec13233c874252bfa3554127498af0d603adec24f5221edd2: Status 404 returned error can't find the container with id 69a541f35cdb658ec13233c874252bfa3554127498af0d603adec24f5221edd2
Jul 20 17:50:39.257406 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.257355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:39.538099 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.538072    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:39.683104 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.683069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:39.874052 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.874028    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d45c48558-659nz" event={"ID":"c10e4515-7555-4f70-90ea-45e3eaeddb30","Type":"ContainerStarted","Data":"2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3"}
Jul 20 17:50:39.874455 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.874081    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d45c48558-659nz" event={"ID":"c10e4515-7555-4f70-90ea-45e3eaeddb30","Type":"ContainerStarted","Data":"69a541f35cdb658ec13233c874252bfa3554127498af0d603adec24f5221edd2"}
Jul 20 17:50:39.877209 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.877179    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93","Type":"ContainerStarted","Data":"223bc76ee3c0e19fd5eccd127a96321deb605aa779f6ec29b73a7ed892c1dcf4"}
Jul 20 17:50:39.877493 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.877262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93","Type":"ContainerStarted","Data":"0ba03bbdf3bfbd25518167f4a5f684c2faf19a26e4feb8d0b5a544d6c2063f92"}
Jul 20 17:50:39.877493 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.877308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93","Type":"ContainerStarted","Data":"69bebef522945d922054a85704afdaccb725073cad41071fff15abee7e8706fd"}
Jul 20 17:50:39.877493 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.877351    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93","Type":"ContainerStarted","Data":"db1ba86362fcb5259122129cff14a1c228be3009af95f042a7b5b83362d201f0"}
Jul 20 17:50:39.880733 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.880702    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx" event={"ID":"b675c70a-ba7e-42a9-a65a-9c93b28207cf","Type":"ContainerStarted","Data":"d541020737f5f30e49709fd79916a6790aa3b914cca19871cacdf17d30f1c0a9"}
Jul 20 17:50:39.880837 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.880766    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx" event={"ID":"b675c70a-ba7e-42a9-a65a-9c93b28207cf","Type":"ContainerStarted","Data":"bccfd5a2a0bf0e6d59369c6da56431981c3b1e266d0d42d76b496d03cc31ae37"}
Jul 20 17:50:39.880837 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.880811    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx" event={"ID":"b675c70a-ba7e-42a9-a65a-9c93b28207cf","Type":"ContainerStarted","Data":"339409ce3d3b4453c2209c15ab92060903dd8f63857ff122f5c6f5a0483a6031"}
Jul 20 17:50:39.880959 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.880884    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:39.916495 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:39.916447    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d45c48558-659nz" podStartSLOduration=1.916425262 podStartE2EDuration="1.916425262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:39.916345944 +0000 UTC m=+147.287939204" watchObservedRunningTime="2026-07-20 17:50:39.916425262 +0000 UTC m=+147.288018522"
Jul 20 17:50:40.888383 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:40.888345    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93","Type":"ContainerStarted","Data":"3099114009a95b4b4a70bcf68cda04f116c0224a7ba26609ee84b057a7c7c9d7"}
Jul 20 17:50:40.888971 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:40.888477    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93","Type":"ContainerStarted","Data":"43e6fc5baa5b33565d4e9d5ab320047d3905effec615fa9c60a06b1e3b30da28"}
Jul 20 17:50:40.927229 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:40.927182    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx" podStartSLOduration=8.910080502 podStartE2EDuration="20.927168695s" totalImagesPullingTime="12.017088193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:39.970578117 +0000 UTC m=+147.342171376" watchObservedRunningTime="2026-07-20 17:50:40.927168695 +0000 UTC m=+148.298761953"
Jul 20 17:50:42.406002 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:42.405965    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:42.411805 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:42.411787    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:42.411908 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:42.411841    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:50:42.687537 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:42.687449    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:45.894325 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:45.894300    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7847db549c-kdkzx"
Jul 20 17:50:45.941676 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:45.941626    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=15.220828225 podStartE2EDuration="27.941608884s" totalImagesPullingTime="12.686503006s" totalInitContainerRuntime="34.277653ms" isStatefulPod=false podCreationTimestamp="2026-07-20 17:50:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:50:40.928182336 +0000 UTC m=+148.299775597" watchObservedRunningTime="2026-07-20 17:50:45.941608884 +0000 UTC m=+153.313202142"
Jul 20 17:50:45.983878 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:45.983830    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c469db766-cqmxh" podUID="03f59727-57e4-4731-a041-a47faf1294e0" containerName="console" containerID="cri-o://76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85" gracePeriod=15
Jul 20 17:50:46.266711 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.266687    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:46.348286 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.348256    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-serving-cert\") pod \"03f59727-57e4-4731-a041-a47faf1294e0\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") "
Jul 20 17:50:46.348496 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.348327    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-oauth-config\") pod \"03f59727-57e4-4731-a041-a47faf1294e0\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") "
Jul 20 17:50:46.348496 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.348364    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-console-config\") pod \"03f59727-57e4-4731-a041-a47faf1294e0\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") "
Jul 20 17:50:46.348496 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.348381    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-service-ca\") pod \"03f59727-57e4-4731-a041-a47faf1294e0\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") "
Jul 20 17:50:46.348496 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.348445    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-oauth-serving-cert\") pod \"03f59727-57e4-4731-a041-a47faf1294e0\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") "
Jul 20 17:50:46.348496 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.348493    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqsrt\" (UniqueName: \"kubernetes.io/projected/03f59727-57e4-4731-a041-a47faf1294e0-kube-api-access-qqsrt\") pod \"03f59727-57e4-4731-a041-a47faf1294e0\" (UID: \"03f59727-57e4-4731-a041-a47faf1294e0\") "
Jul 20 17:50:46.348822 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.348776    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-service-ca" (OuterVolumeSpecName: "service-ca") pod "03f59727-57e4-4731-a041-a47faf1294e0" (UID: "03f59727-57e4-4731-a041-a47faf1294e0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:50:46.348822 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.348783    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-console-config" (OuterVolumeSpecName: "console-config") pod "03f59727-57e4-4731-a041-a47faf1294e0" (UID: "03f59727-57e4-4731-a041-a47faf1294e0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:50:46.348912 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.348848    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03f59727-57e4-4731-a041-a47faf1294e0" (UID: "03f59727-57e4-4731-a041-a47faf1294e0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:50:46.350850 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.350822    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03f59727-57e4-4731-a041-a47faf1294e0" (UID: "03f59727-57e4-4731-a041-a47faf1294e0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 17:50:46.350978 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.350871    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03f59727-57e4-4731-a041-a47faf1294e0-kube-api-access-qqsrt" (OuterVolumeSpecName: "kube-api-access-qqsrt") pod "03f59727-57e4-4731-a041-a47faf1294e0" (UID: "03f59727-57e4-4731-a041-a47faf1294e0"). InnerVolumeSpecName "kube-api-access-qqsrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 17:50:46.350978 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.350873    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03f59727-57e4-4731-a041-a47faf1294e0" (UID: "03f59727-57e4-4731-a041-a47faf1294e0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 17:50:46.449406 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.449319    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqsrt\" (UniqueName: \"kubernetes.io/projected/03f59727-57e4-4731-a041-a47faf1294e0-kube-api-access-qqsrt\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:46.449406 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.449344    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-serving-cert\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:46.449406 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.449354    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03f59727-57e4-4731-a041-a47faf1294e0-console-oauth-config\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:46.449406 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.449364    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-console-config\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:46.449406 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.449373    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:46.449406 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.449380    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03f59727-57e4-4731-a041-a47faf1294e0-oauth-serving-cert\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:46.916775 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.916745    2562 generic.go:356] "Generic (PLEG): container finished" podID="03f59727-57e4-4731-a041-a47faf1294e0" containerID="76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85" exitCode=0
Jul 20 17:50:46.917264 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.916784    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c469db766-cqmxh"
Jul 20 17:50:46.917264 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.916808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c469db766-cqmxh" event={"ID":"03f59727-57e4-4731-a041-a47faf1294e0","Type":"ContainerDied","Data":"76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85"}
Jul 20 17:50:46.917264 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.916855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c469db766-cqmxh" event={"ID":"03f59727-57e4-4731-a041-a47faf1294e0","Type":"ContainerDied","Data":"18ab1992131d3a5077303f7d880dd61c7088c40ff553fd039931b49b48aedc05"}
Jul 20 17:50:46.917264 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.916877    2562 scope.go:117] "RemoveContainer" containerID="76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85"
Jul 20 17:50:46.933923 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.933714    2562 scope.go:117] "RemoveContainer" containerID="76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85"
Jul 20 17:50:46.934237 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:50:46.934210    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85\": container with ID starting with 76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85 not found: ID does not exist" containerID="76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85"
Jul 20 17:50:46.934335 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.934243    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85"} err="failed to get container status \"76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85\": rpc error: code = NotFound desc = could not find container \"76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85\": container with ID starting with 76682c2b22acf4fb34d6669d1af5fc11ca6ca7a960a0ca40f7f3a0920dec0e85 not found: ID does not exist"
Jul 20 17:50:46.950629 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.950599    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c469db766-cqmxh"]
Jul 20 17:50:46.957264 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:46.957241    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c469db766-cqmxh"]
Jul 20 17:50:47.179596 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:47.179524    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03f59727-57e4-4731-a041-a47faf1294e0" path="/var/lib/kubelet/pods/03f59727-57e4-4731-a041-a47faf1294e0/volumes"
Jul 20 17:50:48.954329 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:48.954296    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:48.954761 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:48.954379    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:48.959707 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:48.959685    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:49.935283 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:49.935257    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:50:50.042289 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:50.042253    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d758b7874-cd4gk"]
Jul 20 17:50:50.555959 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:50.555926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:50.703172 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:50.703135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:53.953099 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:53.953064    2562 generic.go:356] "Generic (PLEG): container finished" podID="991597ce-1aec-4c68-9f71-6d108f9be607" containerID="4d27692eb8d756367fe480c9e49b9c045494f75e8cca6352dc72aafa3110e93d" exitCode=0
Jul 20 17:50:53.953568 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:53.953138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-mjkfv" event={"ID":"991597ce-1aec-4c68-9f71-6d108f9be607","Type":"ContainerDied","Data":"4d27692eb8d756367fe480c9e49b9c045494f75e8cca6352dc72aafa3110e93d"}
Jul 20 17:50:53.953568 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:53.953516    2562 scope.go:117] "RemoveContainer" containerID="4d27692eb8d756367fe480c9e49b9c045494f75e8cca6352dc72aafa3110e93d"
Jul 20 17:50:54.959430 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:54.959382    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-mjkfv" event={"ID":"991597ce-1aec-4c68-9f71-6d108f9be607","Type":"ContainerStarted","Data":"51b172fbfa80ab5b06479c44031f9264fbc8a0f741176d12b0ae223aeeb2b750"}
Jul 20 17:50:56.888305 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:56.888262    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b4df9cd74-ts77l" podUID="fe942fca-a8e8-4573-8929-1c99d6389e6a" containerName="console" containerID="cri-o://5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178" gracePeriod=15
Jul 20 17:50:57.165813 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.165742    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:57.349906 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.349869    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-service-ca\") pod \"fe942fca-a8e8-4573-8929-1c99d6389e6a\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") "
Jul 20 17:50:57.350093 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.349927    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-oauth-config\") pod \"fe942fca-a8e8-4573-8929-1c99d6389e6a\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") "
Jul 20 17:50:57.350093 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.349970    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-trusted-ca-bundle\") pod \"fe942fca-a8e8-4573-8929-1c99d6389e6a\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") "
Jul 20 17:50:57.350093 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.349986    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-config\") pod \"fe942fca-a8e8-4573-8929-1c99d6389e6a\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") "
Jul 20 17:50:57.350093 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.350013    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zknkf\" (UniqueName: \"kubernetes.io/projected/fe942fca-a8e8-4573-8929-1c99d6389e6a-kube-api-access-zknkf\") pod \"fe942fca-a8e8-4573-8929-1c99d6389e6a\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") "
Jul 20 17:50:57.350306 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.350174    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-serving-cert\") pod \"fe942fca-a8e8-4573-8929-1c99d6389e6a\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") "
Jul 20 17:50:57.350306 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.350244    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-oauth-serving-cert\") pod \"fe942fca-a8e8-4573-8929-1c99d6389e6a\" (UID: \"fe942fca-a8e8-4573-8929-1c99d6389e6a\") "
Jul 20 17:50:57.350436 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.350380    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-service-ca" (OuterVolumeSpecName: "service-ca") pod "fe942fca-a8e8-4573-8929-1c99d6389e6a" (UID: "fe942fca-a8e8-4573-8929-1c99d6389e6a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:50:57.350607 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.350508    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fe942fca-a8e8-4573-8929-1c99d6389e6a" (UID: "fe942fca-a8e8-4573-8929-1c99d6389e6a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:50:57.350666 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.350651    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:57.350714 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.350684    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fe942fca-a8e8-4573-8929-1c99d6389e6a" (UID: "fe942fca-a8e8-4573-8929-1c99d6389e6a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:50:57.350804 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.350744    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-config" (OuterVolumeSpecName: "console-config") pod "fe942fca-a8e8-4573-8929-1c99d6389e6a" (UID: "fe942fca-a8e8-4573-8929-1c99d6389e6a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:50:57.352360 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.352334    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe942fca-a8e8-4573-8929-1c99d6389e6a-kube-api-access-zknkf" (OuterVolumeSpecName: "kube-api-access-zknkf") pod "fe942fca-a8e8-4573-8929-1c99d6389e6a" (UID: "fe942fca-a8e8-4573-8929-1c99d6389e6a"). InnerVolumeSpecName "kube-api-access-zknkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 17:50:57.352360 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.352346    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fe942fca-a8e8-4573-8929-1c99d6389e6a" (UID: "fe942fca-a8e8-4573-8929-1c99d6389e6a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 17:50:57.352577 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.352419    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fe942fca-a8e8-4573-8929-1c99d6389e6a" (UID: "fe942fca-a8e8-4573-8929-1c99d6389e6a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 17:50:57.451515 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.451452    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zknkf\" (UniqueName: \"kubernetes.io/projected/fe942fca-a8e8-4573-8929-1c99d6389e6a-kube-api-access-zknkf\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:57.451515 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.451474    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-serving-cert\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:57.451515 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.451482    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-oauth-serving-cert\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:57.451515 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.451491    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-oauth-config\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:57.451515 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.451499    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-trusted-ca-bundle\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:57.451515 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.451507    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe942fca-a8e8-4573-8929-1c99d6389e6a-console-config\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:50:57.542631 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.542603    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:57.732934 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.732842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:50:57.974002 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.973971    2562 generic.go:356] "Generic (PLEG): container finished" podID="fe942fca-a8e8-4573-8929-1c99d6389e6a" containerID="5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178" exitCode=0
Jul 20 17:50:57.974502 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.974016    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4df9cd74-ts77l"
Jul 20 17:50:57.974502 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.974062    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4df9cd74-ts77l" event={"ID":"fe942fca-a8e8-4573-8929-1c99d6389e6a","Type":"ContainerDied","Data":"5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178"}
Jul 20 17:50:57.974502 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.974111    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4df9cd74-ts77l" event={"ID":"fe942fca-a8e8-4573-8929-1c99d6389e6a","Type":"ContainerDied","Data":"ed1c2b7e9aa024bbd2184a7d71c2558eaaef1372542e714498dd5192984c8a91"}
Jul 20 17:50:57.974502 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.974138    2562 scope.go:117] "RemoveContainer" containerID="5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178"
Jul 20 17:50:57.983693 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.983676    2562 scope.go:117] "RemoveContainer" containerID="5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178"
Jul 20 17:50:57.983948 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:50:57.983928    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178\": container with ID starting with 5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178 not found: ID does not exist" containerID="5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178"
Jul 20 17:50:57.984008 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:57.983958    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178"} err="failed to get container status \"5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178\": rpc error: code = NotFound desc = could not find container \"5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178\": container with ID starting with 5efc1a9b6c0ea34f85c89b98e000cb2c257e6769631c991506b39aeda856d178 not found: ID does not exist"
Jul 20 17:50:58.050412 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:58.050366    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b4df9cd74-ts77l"]
Jul 20 17:50:58.062210 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:58.062185    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b4df9cd74-ts77l"]
Jul 20 17:50:59.179375 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:50:59.179342    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe942fca-a8e8-4573-8929-1c99d6389e6a" path="/var/lib/kubelet/pods/fe942fca-a8e8-4573-8929-1c99d6389e6a/volumes"
Jul 20 17:51:01.107080 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:01.107043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:51:01.239183 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:01.239147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:51:01.412494 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:01.412380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:51:02.417475 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:02.417444    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:51:02.421203 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:02.421184    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85f5756564-pjq4n"
Jul 20 17:51:15.062326 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.062280    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d758b7874-cd4gk" podUID="727359bc-f43d-44e6-9bf9-34864c608ef2" containerName="console" containerID="cri-o://d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f" gracePeriod=15
Jul 20 17:51:15.848354 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.848332    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:51:15.898748 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.898722    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-oauth-config\") pod \"727359bc-f43d-44e6-9bf9-34864c608ef2\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") "
Jul 20 17:51:15.898748 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.898753    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-console-config\") pod \"727359bc-f43d-44e6-9bf9-34864c608ef2\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") "
Jul 20 17:51:15.899006 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.898780    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkwbn\" (UniqueName: \"kubernetes.io/projected/727359bc-f43d-44e6-9bf9-34864c608ef2-kube-api-access-fkwbn\") pod \"727359bc-f43d-44e6-9bf9-34864c608ef2\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") "
Jul 20 17:51:15.899006 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.898891    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-serving-cert\") pod \"727359bc-f43d-44e6-9bf9-34864c608ef2\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") "
Jul 20 17:51:15.899006 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.898927    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-oauth-serving-cert\") pod \"727359bc-f43d-44e6-9bf9-34864c608ef2\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") "
Jul 20 17:51:15.899006 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.898955    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-trusted-ca-bundle\") pod \"727359bc-f43d-44e6-9bf9-34864c608ef2\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") "
Jul 20 17:51:15.899307 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.899052    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-service-ca\") pod \"727359bc-f43d-44e6-9bf9-34864c608ef2\" (UID: \"727359bc-f43d-44e6-9bf9-34864c608ef2\") "
Jul 20 17:51:15.899307 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.899215    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-console-config" (OuterVolumeSpecName: "console-config") pod "727359bc-f43d-44e6-9bf9-34864c608ef2" (UID: "727359bc-f43d-44e6-9bf9-34864c608ef2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:51:15.899446 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.899351    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-console-config\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:51:15.899446 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.899359    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "727359bc-f43d-44e6-9bf9-34864c608ef2" (UID: "727359bc-f43d-44e6-9bf9-34864c608ef2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:51:15.899446 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.899279    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "727359bc-f43d-44e6-9bf9-34864c608ef2" (UID: "727359bc-f43d-44e6-9bf9-34864c608ef2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:51:15.899568 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.899459    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-service-ca" (OuterVolumeSpecName: "service-ca") pod "727359bc-f43d-44e6-9bf9-34864c608ef2" (UID: "727359bc-f43d-44e6-9bf9-34864c608ef2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:51:15.901030 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.901005    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "727359bc-f43d-44e6-9bf9-34864c608ef2" (UID: "727359bc-f43d-44e6-9bf9-34864c608ef2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 17:51:15.901190 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.901172    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "727359bc-f43d-44e6-9bf9-34864c608ef2" (UID: "727359bc-f43d-44e6-9bf9-34864c608ef2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 17:51:15.901443 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:15.901413    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/727359bc-f43d-44e6-9bf9-34864c608ef2-kube-api-access-fkwbn" (OuterVolumeSpecName: "kube-api-access-fkwbn") pod "727359bc-f43d-44e6-9bf9-34864c608ef2" (UID: "727359bc-f43d-44e6-9bf9-34864c608ef2"). InnerVolumeSpecName "kube-api-access-fkwbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 17:51:16.000642 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.000563    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:51:16.000642 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.000587    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-oauth-config\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:51:16.000642 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.000597    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkwbn\" (UniqueName: \"kubernetes.io/projected/727359bc-f43d-44e6-9bf9-34864c608ef2-kube-api-access-fkwbn\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:51:16.000642 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.000606    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/727359bc-f43d-44e6-9bf9-34864c608ef2-console-serving-cert\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:51:16.000642 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.000614    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-oauth-serving-cert\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:51:16.000642 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.000622    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727359bc-f43d-44e6-9bf9-34864c608ef2-trusted-ca-bundle\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:51:16.066433 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.066373    2562 generic.go:356] "Generic (PLEG): container finished" podID="727359bc-f43d-44e6-9bf9-34864c608ef2" containerID="d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f" exitCode=0
Jul 20 17:51:16.066883 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.066451    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d758b7874-cd4gk"
Jul 20 17:51:16.066883 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.066465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d758b7874-cd4gk" event={"ID":"727359bc-f43d-44e6-9bf9-34864c608ef2","Type":"ContainerDied","Data":"d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f"}
Jul 20 17:51:16.066883 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.066532    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d758b7874-cd4gk" event={"ID":"727359bc-f43d-44e6-9bf9-34864c608ef2","Type":"ContainerDied","Data":"024373b28111572dd813b14261ac427e1ceef44e0498d58423fa616db03e0333"}
Jul 20 17:51:16.066883 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.066561    2562 scope.go:117] "RemoveContainer" containerID="d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f"
Jul 20 17:51:16.075443 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.075422    2562 scope.go:117] "RemoveContainer" containerID="d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f"
Jul 20 17:51:16.075762 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:51:16.075744    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f\": container with ID starting with d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f not found: ID does not exist" containerID="d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f"
Jul 20 17:51:16.075823 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.075770    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f"} err="failed to get container status \"d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f\": rpc error: code = NotFound desc = could not find container \"d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f\": container with ID starting with d97f7dc3f5be76fd4f57537b7da784d91bafd4a0bbc65e3c38322a768930316f not found: ID does not exist"
Jul 20 17:51:16.098149 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.098122    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d758b7874-cd4gk"]
Jul 20 17:51:16.110772 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:16.110747    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d758b7874-cd4gk"]
Jul 20 17:51:17.179830 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:17.179798    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="727359bc-f43d-44e6-9bf9-34864c608ef2" path="/var/lib/kubelet/pods/727359bc-f43d-44e6-9bf9-34864c608ef2/volumes"
Jul 20 17:51:28.482678 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:51:28.482644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:52:06.018377 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:52:06.018338    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:52:24.921656 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:52:24.921620    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:52:25.025177 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:52:25.025144    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:53:13.009703 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:53:13.009673    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 17:53:13.013820 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:53:13.013797    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 17:53:13.016268 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:53:13.016253    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 17:55:24.919144 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:24.919111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:55:26.613217 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:26.613189    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:55:28.155053 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.155023    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 17:55:28.155435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.155374    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe942fca-a8e8-4573-8929-1c99d6389e6a" containerName="console"
Jul 20 17:55:28.155435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.155385    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe942fca-a8e8-4573-8929-1c99d6389e6a" containerName="console"
Jul 20 17:55:28.155435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.155412    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03f59727-57e4-4731-a041-a47faf1294e0" containerName="console"
Jul 20 17:55:28.155435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.155420    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="03f59727-57e4-4731-a041-a47faf1294e0" containerName="console"
Jul 20 17:55:28.155435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.155431    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="727359bc-f43d-44e6-9bf9-34864c608ef2" containerName="console"
Jul 20 17:55:28.155435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.155436    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="727359bc-f43d-44e6-9bf9-34864c608ef2" containerName="console"
Jul 20 17:55:28.155628 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.155494    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe942fca-a8e8-4573-8929-1c99d6389e6a" containerName="console"
Jul 20 17:55:28.155628 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.155504    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="727359bc-f43d-44e6-9bf9-34864c608ef2" containerName="console"
Jul 20 17:55:28.155628 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.155515    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="03f59727-57e4-4731-a041-a47faf1294e0" containerName="console"
Jul 20 17:55:28.158704 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.158690    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.161518 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.161481    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 17:55:28.161667 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.161543    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 17:55:28.161667 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.161608    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 17:55:28.161667 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.161653    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 17:55:28.161874 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.161674    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 17:55:28.161874 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.161659    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 17:55:28.161874 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.161812    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 17:55:28.162067 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.162012    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 17:55:28.162288 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.162274    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2p5d2\""
Jul 20 17:55:28.163027 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.163013    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 17:55:28.164117 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.164104    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4r03vugd5vkma\""
Jul 20 17:55:28.166748 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.166733    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 17:55:28.170835 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.170820    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 17:55:28.174403 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.174369    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 17:55:28.174604 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.174589    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 17:55:28.184048 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.184033    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 17:55:28.215833 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.215806    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 17:55:28.228892 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.228871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:55:28.290175 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290175 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ce808c-85bc-4bda-b86a-11824e327a62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290435 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290794 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290794 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290794 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290794 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-config\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290794 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ce808c-85bc-4bda-b86a-11824e327a62-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290794 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290794 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hddzk\" (UniqueName: \"kubernetes.io/projected/b9ce808c-85bc-4bda-b86a-11824e327a62-kube-api-access-hddzk\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290794 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.290794 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.290728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392181 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392355 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392355 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392355 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392355 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392326    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392355 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-config\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ce808c-85bc-4bda-b86a-11824e327a62-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hddzk\" (UniqueName: \"kubernetes.io/projected/b9ce808c-85bc-4bda-b86a-11824e327a62-kube-api-access-hddzk\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392535    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ce808c-85bc-4bda-b86a-11824e327a62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392647    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.392698 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.393352 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.393352 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.392754    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.393352 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.393026    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.393352 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.393072    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.396422 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.395615    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.396422 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.395623    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.396422 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.395657    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.396422 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.396020    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.396422 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.396141    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.396422 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.396271    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.396422 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.396293    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.397036 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.396985    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.397099 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.397076    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9ce808c-85bc-4bda-b86a-11824e327a62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.397407 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.397227    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9ce808c-85bc-4bda-b86a-11824e327a62-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.397630 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.397605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.398073 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.398045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-config\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.398290 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.398269    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9ce808c-85bc-4bda-b86a-11824e327a62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.398532 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.398514    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.398832 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.398815    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.399550 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.399535    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9ce808c-85bc-4bda-b86a-11824e327a62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.404952 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.404936    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hddzk\" (UniqueName: \"kubernetes.io/projected/b9ce808c-85bc-4bda-b86a-11824e327a62-kube-api-access-hddzk\") pod \"prometheus-k8s-0\" (UID: \"b9ce808c-85bc-4bda-b86a-11824e327a62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.468476 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.468386    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:55:28.618192 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:28.616446    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 17:55:28.621827 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:55:28.621802    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ce808c_85bc_4bda_b86a_11824e327a62.slice/crio-4be1aa14bdc26eee0c08e2f68fda4d13178f237397205528bd2c0a8b605387fa WatchSource:0}: Error finding container 4be1aa14bdc26eee0c08e2f68fda4d13178f237397205528bd2c0a8b605387fa: Status 404 returned error can't find the container with id 4be1aa14bdc26eee0c08e2f68fda4d13178f237397205528bd2c0a8b605387fa
Jul 20 17:55:29.055023 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:29.054986    2562 generic.go:356] "Generic (PLEG): container finished" podID="b9ce808c-85bc-4bda-b86a-11824e327a62" containerID="1c1033a03f728b13c75c1d179e518458348334e66c26ca7668508b3549b7f13a" exitCode=0
Jul 20 17:55:29.055193 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:29.055076    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ce808c-85bc-4bda-b86a-11824e327a62","Type":"ContainerDied","Data":"1c1033a03f728b13c75c1d179e518458348334e66c26ca7668508b3549b7f13a"}
Jul 20 17:55:29.055193 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:29.055142    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ce808c-85bc-4bda-b86a-11824e327a62","Type":"ContainerStarted","Data":"4be1aa14bdc26eee0c08e2f68fda4d13178f237397205528bd2c0a8b605387fa"}
Jul 20 17:55:29.056293 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:29.056280    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 17:55:33.074471 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:33.074429    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ce808c-85bc-4bda-b86a-11824e327a62","Type":"ContainerStarted","Data":"bc3c769c633ef096fe3ca1c54e036aba7ef7609450722f8f5e10e63da7db133c"}
Jul 20 17:55:33.074841 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:33.074501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ce808c-85bc-4bda-b86a-11824e327a62","Type":"ContainerStarted","Data":"887a5871afefb2a169c865d1f2b3e9776fc4c18f4ef2737d72f00c7dad3df065"}
Jul 20 17:55:33.074841 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:33.074526    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ce808c-85bc-4bda-b86a-11824e327a62","Type":"ContainerStarted","Data":"43f82ced869582d3b8aa041dd2913506c9145644407f9ce4ba4733bfa5620a06"}
Jul 20 17:55:33.074841 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:33.074563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ce808c-85bc-4bda-b86a-11824e327a62","Type":"ContainerStarted","Data":"fa30bcf2c78e7ad8da49c6beabf859cd05388a804567691917fd751ce453bb32"}
Jul 20 17:55:33.074841 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:33.074590    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ce808c-85bc-4bda-b86a-11824e327a62","Type":"ContainerStarted","Data":"ba6800e09a7786697f2ae7555c97d6f026e0e989144f93305c1743fe8030fd43"}
Jul 20 17:55:33.074841 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:33.074611    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9ce808c-85bc-4bda-b86a-11824e327a62","Type":"ContainerStarted","Data":"d646e7ce4761cea7f39a463f93bfac9886f36615957ace8917680769c65de4d8"}
Jul 20 17:55:33.108592 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:33.108533    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.8188018910000001 podStartE2EDuration="5.108512034s" totalImagesPullingTime="3.271286147s" totalInitContainerRuntime="18.423996ms" isStatefulPod=false podCreationTimestamp="2026-07-20 17:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:55:33.106765619 +0000 UTC m=+440.478358877" watchObservedRunningTime="2026-07-20 17:55:33.108512034 +0000 UTC m=+440.480105307"
Jul 20 17:55:33.469155 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:55:33.469122    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:56:11.509156 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:11.509122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:28.469169 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:28.469128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:56:28.485633 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:28.485610    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:56:29.330519 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:29.330479    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 17:56:38.044843 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:38.044808    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:38.117709 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:38.117673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:49.953733 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:49.953691    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:50.019221 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:50.019185    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:53.920687 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:53.920652    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dcb46b894-9t8q7"]
Jul 20 17:56:53.922909 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:53.922891    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:53.935210 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:53.935186    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dcb46b894-9t8q7"]
Jul 20 17:56:54.014808 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.014777    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:54.037073 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.037039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-oauth-config\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.037208 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.037087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj5p9\" (UniqueName: \"kubernetes.io/projected/462f9cbf-9c36-45ae-a7af-7a308e303adf-kube-api-access-gj5p9\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.037208 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.037167    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-trusted-ca-bundle\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.037282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.037215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-service-ca\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.037282 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.037269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-serving-cert\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.037343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.037298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-config\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.037343 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.037332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-oauth-serving-cert\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.069831 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.069795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:54.138201 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.138163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-oauth-serving-cert\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.138416 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.138216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-oauth-config\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.138416 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.138250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj5p9\" (UniqueName: \"kubernetes.io/projected/462f9cbf-9c36-45ae-a7af-7a308e303adf-kube-api-access-gj5p9\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.138416 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.138277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-trusted-ca-bundle\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.138416 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.138306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-service-ca\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.138416 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.138327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-serving-cert\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.138416 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.138352    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-config\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.139114 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.139051    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-oauth-serving-cert\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.139114 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.139100    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-config\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.139425 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.139231    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-service-ca\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.139584 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.139541    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-trusted-ca-bundle\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.141097 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.141068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-oauth-config\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.141185 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.141157    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-serving-cert\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.147996 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.147976    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj5p9\" (UniqueName: \"kubernetes.io/projected/462f9cbf-9c36-45ae-a7af-7a308e303adf-kube-api-access-gj5p9\") pod \"console-7dcb46b894-9t8q7\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") " pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.232549 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.232454    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:56:54.322269 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.322235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:54.370301 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.370143    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dcb46b894-9t8q7"]
Jul 20 17:56:54.373214 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:56:54.373190    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462f9cbf_9c36_45ae_a7af_7a308e303adf.slice/crio-3442dff974e51d11349ca6d36b8d6fb2bbe9efbd8518fc830128ca5648bed1ee WatchSource:0}: Error finding container 3442dff974e51d11349ca6d36b8d6fb2bbe9efbd8518fc830128ca5648bed1ee: Status 404 returned error can't find the container with id 3442dff974e51d11349ca6d36b8d6fb2bbe9efbd8518fc830128ca5648bed1ee
Jul 20 17:56:54.423193 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.423146    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:54.425037 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.425016    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcb46b894-9t8q7" event={"ID":"462f9cbf-9c36-45ae-a7af-7a308e303adf","Type":"ContainerStarted","Data":"3442dff974e51d11349ca6d36b8d6fb2bbe9efbd8518fc830128ca5648bed1ee"}
Jul 20 17:56:54.936550 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:54.936517    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:55.430416 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:55.430354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcb46b894-9t8q7" event={"ID":"462f9cbf-9c36-45ae-a7af-7a308e303adf","Type":"ContainerStarted","Data":"0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85"}
Jul 20 17:56:55.452462 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:55.452408    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dcb46b894-9t8q7" podStartSLOduration=2.452377049 podStartE2EDuration="2.452377049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:56:55.450460917 +0000 UTC m=+522.822054177" watchObservedRunningTime="2026-07-20 17:56:55.452377049 +0000 UTC m=+522.823970309"
Jul 20 17:56:57.445842 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:57.445806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:56:57.503443 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:56:57.503362    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:04.233132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:04.233045    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:57:04.233132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:04.233108    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:57:04.237845 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:04.237816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:57:04.476342 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:04.476318    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 17:57:04.517611 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:04.517539    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d45c48558-659nz"]
Jul 20 17:57:04.609826 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:04.609793    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:04.737653 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:04.737616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:04.792472 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:04.792382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:29.545917 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.545861    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d45c48558-659nz" podUID="c10e4515-7555-4f70-90ea-45e3eaeddb30" containerName="console" containerID="cri-o://2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3" gracePeriod=15
Jul 20 17:57:29.801674 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.801619    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:57:29.858080 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858046    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-oauth-serving-cert\") pod \"c10e4515-7555-4f70-90ea-45e3eaeddb30\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") "
Jul 20 17:57:29.858250 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858095    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-serving-cert\") pod \"c10e4515-7555-4f70-90ea-45e3eaeddb30\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") "
Jul 20 17:57:29.858250 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858129    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-service-ca\") pod \"c10e4515-7555-4f70-90ea-45e3eaeddb30\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") "
Jul 20 17:57:29.858250 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858152    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-trusted-ca-bundle\") pod \"c10e4515-7555-4f70-90ea-45e3eaeddb30\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") "
Jul 20 17:57:29.858250 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858193    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-config\") pod \"c10e4515-7555-4f70-90ea-45e3eaeddb30\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") "
Jul 20 17:57:29.858250 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858234    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-oauth-config\") pod \"c10e4515-7555-4f70-90ea-45e3eaeddb30\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") "
Jul 20 17:57:29.858536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858270    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4qtx\" (UniqueName: \"kubernetes.io/projected/c10e4515-7555-4f70-90ea-45e3eaeddb30-kube-api-access-v4qtx\") pod \"c10e4515-7555-4f70-90ea-45e3eaeddb30\" (UID: \"c10e4515-7555-4f70-90ea-45e3eaeddb30\") "
Jul 20 17:57:29.858536 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858450    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c10e4515-7555-4f70-90ea-45e3eaeddb30" (UID: "c10e4515-7555-4f70-90ea-45e3eaeddb30"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:57:29.858642 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858595    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-oauth-serving-cert\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:57:29.858642 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858610    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-service-ca" (OuterVolumeSpecName: "service-ca") pod "c10e4515-7555-4f70-90ea-45e3eaeddb30" (UID: "c10e4515-7555-4f70-90ea-45e3eaeddb30"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:57:29.858740 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858668    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c10e4515-7555-4f70-90ea-45e3eaeddb30" (UID: "c10e4515-7555-4f70-90ea-45e3eaeddb30"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:57:29.858740 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.858681    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-config" (OuterVolumeSpecName: "console-config") pod "c10e4515-7555-4f70-90ea-45e3eaeddb30" (UID: "c10e4515-7555-4f70-90ea-45e3eaeddb30"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 17:57:29.860522 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.860494    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c10e4515-7555-4f70-90ea-45e3eaeddb30" (UID: "c10e4515-7555-4f70-90ea-45e3eaeddb30"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 17:57:29.860618 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.860551    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c10e4515-7555-4f70-90ea-45e3eaeddb30-kube-api-access-v4qtx" (OuterVolumeSpecName: "kube-api-access-v4qtx") pod "c10e4515-7555-4f70-90ea-45e3eaeddb30" (UID: "c10e4515-7555-4f70-90ea-45e3eaeddb30"). InnerVolumeSpecName "kube-api-access-v4qtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 17:57:29.860674 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.860636    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c10e4515-7555-4f70-90ea-45e3eaeddb30" (UID: "c10e4515-7555-4f70-90ea-45e3eaeddb30"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 17:57:29.959496 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.959445    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-oauth-config\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:57:29.959496 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.959489    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4qtx\" (UniqueName: \"kubernetes.io/projected/c10e4515-7555-4f70-90ea-45e3eaeddb30-kube-api-access-v4qtx\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:57:29.959496 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.959502    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-serving-cert\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:57:29.959739 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.959517    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:57:29.959739 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.959531    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-trusted-ca-bundle\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:57:29.959739 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:29.959543    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c10e4515-7555-4f70-90ea-45e3eaeddb30-console-config\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 17:57:30.580137 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:30.580104    2562 generic.go:356] "Generic (PLEG): container finished" podID="c10e4515-7555-4f70-90ea-45e3eaeddb30" containerID="2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3" exitCode=0
Jul 20 17:57:30.580588 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:30.580149    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d45c48558-659nz"
Jul 20 17:57:30.580588 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:30.580154    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d45c48558-659nz" event={"ID":"c10e4515-7555-4f70-90ea-45e3eaeddb30","Type":"ContainerDied","Data":"2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3"}
Jul 20 17:57:30.580588 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:30.580194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d45c48558-659nz" event={"ID":"c10e4515-7555-4f70-90ea-45e3eaeddb30","Type":"ContainerDied","Data":"69a541f35cdb658ec13233c874252bfa3554127498af0d603adec24f5221edd2"}
Jul 20 17:57:30.580588 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:30.580215    2562 scope.go:117] "RemoveContainer" containerID="2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3"
Jul 20 17:57:30.589296 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:30.589280    2562 scope.go:117] "RemoveContainer" containerID="2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3"
Jul 20 17:57:30.589567 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:57:30.589548    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3\": container with ID starting with 2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3 not found: ID does not exist" containerID="2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3"
Jul 20 17:57:30.589631 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:30.589574    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3"} err="failed to get container status \"2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3\": rpc error: code = NotFound desc = could not find container \"2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3\": container with ID starting with 2c80a51eec2838d712acf5d862db1f66aed9a7460e846012a1fd69ec38ed5bd3 not found: ID does not exist"
Jul 20 17:57:30.602406 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:30.602368    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d45c48558-659nz"]
Jul 20 17:57:30.605850 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:30.605828    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d45c48558-659nz"]
Jul 20 17:57:31.180051 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:31.180018    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c10e4515-7555-4f70-90ea-45e3eaeddb30" path="/var/lib/kubelet/pods/c10e4515-7555-4f70-90ea-45e3eaeddb30/volumes"
Jul 20 17:57:42.074313 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:42.074275    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:57:42.169647 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:57:42.169615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:09.036733 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:09.036698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:10.462997 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:10.462965    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:12.195439 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:12.195379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:12.849711 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:12.849682    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:12.949549 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:12.949520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:13.039441 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:13.039406    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 17:58:13.043103 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:13.043081    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 17:58:15.730290 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:15.730251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:15.893800 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:15.893766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:16.361778 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:16.361741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:16.549484 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:16.549444    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:18.699832 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:18.699774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:19.157478 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:19.157440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:20.064289 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:20.064250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:20.143496 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:20.143465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:25.912720 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:25.912688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:30.047831 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:30.047797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:30.147756 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:30.147696    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:31.778706 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:31.778673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:36.863778 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:36.863699    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:36.982896 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:36.982863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:38.558854 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:38.558824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:51.689859 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:51.689781    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:51.795260 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:51.795229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:52.353357 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:52.353326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:52.459071 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:52.459039    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:52.564474 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:52.564447    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:52.784276 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:52.784195    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:52.880672 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:52.880644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:53.003734 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.003707    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"]
Jul 20 17:58:53.004065 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.004054    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c10e4515-7555-4f70-90ea-45e3eaeddb30" containerName="console"
Jul 20 17:58:53.004108 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.004067    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c10e4515-7555-4f70-90ea-45e3eaeddb30" containerName="console"
Jul 20 17:58:53.004142 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.004125    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c10e4515-7555-4f70-90ea-45e3eaeddb30" containerName="console"
Jul 20 17:58:53.007155 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.007139    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.011194 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.011173    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 17:58:53.011348 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.011175    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 17:58:53.011438 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.011251    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 17:58:53.011438 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.011290    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 17:58:53.011786 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.011772    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jtcl9\""
Jul 20 17:58:53.042160 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.042073    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"]
Jul 20 17:58:53.097988 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.097944    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6465f52e-70e1-4556-a680-3cd56b964666-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.097988 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.097988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6465f52e-70e1-4556-a680-3cd56b964666-tmp\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.098185 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.098016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg7cb\" (UniqueName: \"kubernetes.io/projected/6465f52e-70e1-4556-a680-3cd56b964666-kube-api-access-cg7cb\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.098185 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.098097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6465f52e-70e1-4556-a680-3cd56b964666-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.098185 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.098161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6465f52e-70e1-4556-a680-3cd56b964666-manifests\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.199118 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.199088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6465f52e-70e1-4556-a680-3cd56b964666-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.199118 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.199124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6465f52e-70e1-4556-a680-3cd56b964666-tmp\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.199315 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.199247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg7cb\" (UniqueName: \"kubernetes.io/projected/6465f52e-70e1-4556-a680-3cd56b964666-kube-api-access-cg7cb\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.199315 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.199293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6465f52e-70e1-4556-a680-3cd56b964666-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.199448 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.199342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6465f52e-70e1-4556-a680-3cd56b964666-manifests\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.199701 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.199679    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6465f52e-70e1-4556-a680-3cd56b964666-manifests\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.201729 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.201709    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6465f52e-70e1-4556-a680-3cd56b964666-tmp\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.201858 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.201791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6465f52e-70e1-4556-a680-3cd56b964666-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.201927 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.201913    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6465f52e-70e1-4556-a680-3cd56b964666-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.215678 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.215650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg7cb\" (UniqueName: \"kubernetes.io/projected/6465f52e-70e1-4556-a680-3cd56b964666-kube-api-access-cg7cb\") pod \"opendatahub-operator-controller-manager-7f8f8bd966-tk9zh\" (UID: \"6465f52e-70e1-4556-a680-3cd56b964666\") " pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.228297 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.228275    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:53.317523 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.317445    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:53.446922 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.446889    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:53.474572 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.474534    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"]
Jul 20 17:58:53.477524 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:58:53.477496    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6465f52e_70e1_4556_a680_3cd56b964666.slice/crio-b32b21b2c19418315c3b1cee815915e095acdad46e38e0f9142cc82fea1cda66 WatchSource:0}: Error finding container b32b21b2c19418315c3b1cee815915e095acdad46e38e0f9142cc82fea1cda66: Status 404 returned error can't find the container with id b32b21b2c19418315c3b1cee815915e095acdad46e38e0f9142cc82fea1cda66
Jul 20 17:58:53.547639 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.547609    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:53.642866 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.642831    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:53.744877 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.744821    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:53.843934 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.843885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:53.928008 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:53.927938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh" event={"ID":"6465f52e-70e1-4556-a680-3cd56b964666","Type":"ContainerStarted","Data":"b32b21b2c19418315c3b1cee815915e095acdad46e38e0f9142cc82fea1cda66"}
Jul 20 17:58:56.857378 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:56.857348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:56.946314 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:56.946280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh" event={"ID":"6465f52e-70e1-4556-a680-3cd56b964666","Type":"ContainerStarted","Data":"0dcbce6fc7d5d8718d2df6784346ca07b94b4b0abfa7943dcfd758557e0197f6"}
Jul 20 17:58:56.967101 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:56.967074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:58:57.952072 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:57.951981    2562 generic.go:356] "Generic (PLEG): container finished" podID="6465f52e-70e1-4556-a680-3cd56b964666" containerID="0dcbce6fc7d5d8718d2df6784346ca07b94b4b0abfa7943dcfd758557e0197f6" exitCode=0
Jul 20 17:58:57.952072 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:57.952026    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh" event={"ID":"6465f52e-70e1-4556-a680-3cd56b964666","Type":"ContainerDied","Data":"0dcbce6fc7d5d8718d2df6784346ca07b94b4b0abfa7943dcfd758557e0197f6"}
Jul 20 17:58:58.958332 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:58.958237    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh" event={"ID":"6465f52e-70e1-4556-a680-3cd56b964666","Type":"ContainerStarted","Data":"87549e36ad8e9a50ba5899ed7db8295eac342e76f64fdcc74c66c8030a2e1e03"}
Jul 20 17:58:58.958739 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:58.958461    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:58:58.982441 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:58:58.982383    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh" podStartSLOduration=2.28669227 podStartE2EDuration="6.982368467s" totalImagesPullingTime="3.601918085s" totalInitContainerRuntime="1.093758112s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:58:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:58:58.980413361 +0000 UTC m=+646.352006620" watchObservedRunningTime="2026-07-20 17:58:58.982368467 +0000 UTC m=+646.353961726"
Jul 20 17:59:04.105759 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:04.105720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:04.264904 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:04.264871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:04.967432 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:04.967374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:05.083715 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:05.083687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:09.965288 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:09.965258    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f8f8bd966-tk9zh"
Jul 20 17:59:11.479068 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.479036    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"]
Jul 20 17:59:11.484831 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.484806    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.489459 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.489435    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 17:59:11.489595 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.489467    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 17:59:11.489595 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.489437    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 17:59:11.489707 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.489609    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 17:59:11.489707 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.489610    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2kkf2\""
Jul 20 17:59:11.489819 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.489748    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 17:59:11.513059 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.513033    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"]
Jul 20 17:59:11.571044 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.571007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc95a997-434f-4b38-9919-70eb844d12fc-metrics-cert\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.571212 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.571067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgtkm\" (UniqueName: \"kubernetes.io/projected/bc95a997-434f-4b38-9919-70eb844d12fc-kube-api-access-xgtkm\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.571212 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.571177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc95a997-434f-4b38-9919-70eb844d12fc-manager-config\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.571212 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.571200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc95a997-434f-4b38-9919-70eb844d12fc-cert\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.672565 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.672531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc95a997-434f-4b38-9919-70eb844d12fc-metrics-cert\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.672755 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.672590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgtkm\" (UniqueName: \"kubernetes.io/projected/bc95a997-434f-4b38-9919-70eb844d12fc-kube-api-access-xgtkm\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.672755 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.672670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc95a997-434f-4b38-9919-70eb844d12fc-manager-config\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.672755 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.672694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc95a997-434f-4b38-9919-70eb844d12fc-cert\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.673429 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.673301    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bc95a997-434f-4b38-9919-70eb844d12fc-manager-config\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.675292 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.675268    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bc95a997-434f-4b38-9919-70eb844d12fc-metrics-cert\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.675415 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.675325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc95a997-434f-4b38-9919-70eb844d12fc-cert\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.690492 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.690462    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgtkm\" (UniqueName: \"kubernetes.io/projected/bc95a997-434f-4b38-9919-70eb844d12fc-kube-api-access-xgtkm\") pod \"lws-controller-manager-7974845875-8cr4r\" (UID: \"bc95a997-434f-4b38-9919-70eb844d12fc\") " pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.794131 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.794003    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:11.842684 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:11.842647    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:12.026471 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:12.026439    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"]
Jul 20 17:59:12.041327 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:59:12.041304    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc95a997_434f_4b38_9919_70eb844d12fc.slice/crio-df4b22028fea06b5374a61ae990742ac996a8d8baafa09574a11bdb19b95a662 WatchSource:0}: Error finding container df4b22028fea06b5374a61ae990742ac996a8d8baafa09574a11bdb19b95a662: Status 404 returned error can't find the container with id df4b22028fea06b5374a61ae990742ac996a8d8baafa09574a11bdb19b95a662
Jul 20 17:59:12.081781 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:12.081751    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:12.921654 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:12.921566    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:13.023720 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:13.023687    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r" event={"ID":"bc95a997-434f-4b38-9919-70eb844d12fc","Type":"ContainerStarted","Data":"df4b22028fea06b5374a61ae990742ac996a8d8baafa09574a11bdb19b95a662"}
Jul 20 17:59:13.086592 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:13.086555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:13.265558 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:13.265473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:13.861853 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:13.861821    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:14.044661 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:14.044628    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:15.034863 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:15.034829    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r" event={"ID":"bc95a997-434f-4b38-9919-70eb844d12fc","Type":"ContainerStarted","Data":"363cbb99cb5eb10aaf49e70ac091c0d77b856310663feeafc866ed3b3e13ae07"}
Jul 20 17:59:15.035040 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:15.034959    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:15.055117 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:15.055068    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r" podStartSLOduration=1.912212834 podStartE2EDuration="4.055052604s" totalImagesPullingTime="2.14283977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:59:15.054490908 +0000 UTC m=+662.426084168" watchObservedRunningTime="2026-07-20 17:59:15.055052604 +0000 UTC m=+662.426645862"
Jul 20 17:59:17.772165 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:17.772127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:17.832495 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:17.832466    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b99948476-bwncd"]
Jul 20 17:59:17.836431 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:17.836414    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:17.839043 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:17.839023    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 17:59:17.839184 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:17.839127    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 17:59:17.839184 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:17.839160    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6cl9b\""
Jul 20 17:59:17.847246 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:17.847222    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b99948476-bwncd"]
Jul 20 17:59:17.935423 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:17.935358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a2c9e70-f3ac-4853-ad63-a300f0636382-tmp\") pod \"kube-auth-proxy-b99948476-bwncd\" (UID: \"8a2c9e70-f3ac-4853-ad63-a300f0636382\") " pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:17.935614 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:17.935436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hm8x\" (UniqueName: \"kubernetes.io/projected/8a2c9e70-f3ac-4853-ad63-a300f0636382-kube-api-access-9hm8x\") pod \"kube-auth-proxy-b99948476-bwncd\" (UID: \"8a2c9e70-f3ac-4853-ad63-a300f0636382\") " pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:17.935614 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:17.935560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a2c9e70-f3ac-4853-ad63-a300f0636382-tls-certs\") pod \"kube-auth-proxy-b99948476-bwncd\" (UID: \"8a2c9e70-f3ac-4853-ad63-a300f0636382\") " pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:18.036446 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:18.036346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a2c9e70-f3ac-4853-ad63-a300f0636382-tls-certs\") pod \"kube-auth-proxy-b99948476-bwncd\" (UID: \"8a2c9e70-f3ac-4853-ad63-a300f0636382\") " pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:18.036446 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:18.036415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a2c9e70-f3ac-4853-ad63-a300f0636382-tmp\") pod \"kube-auth-proxy-b99948476-bwncd\" (UID: \"8a2c9e70-f3ac-4853-ad63-a300f0636382\") " pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:18.036446 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:18.036437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hm8x\" (UniqueName: \"kubernetes.io/projected/8a2c9e70-f3ac-4853-ad63-a300f0636382-kube-api-access-9hm8x\") pod \"kube-auth-proxy-b99948476-bwncd\" (UID: \"8a2c9e70-f3ac-4853-ad63-a300f0636382\") " pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:18.036687 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:59:18.036531    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 20 17:59:18.036687 ip-10-0-141-126 kubenswrapper[2562]: E0720 17:59:18.036605    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2c9e70-f3ac-4853-ad63-a300f0636382-tls-certs podName:8a2c9e70-f3ac-4853-ad63-a300f0636382 nodeName:}" failed. No retries permitted until 2026-07-20 17:59:18.536582114 +0000 UTC m=+665.908175351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8a2c9e70-f3ac-4853-ad63-a300f0636382-tls-certs") pod "kube-auth-proxy-b99948476-bwncd" (UID: "8a2c9e70-f3ac-4853-ad63-a300f0636382") : secret "kube-auth-proxy-tls" not found
Jul 20 17:59:18.038879 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:18.038856    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a2c9e70-f3ac-4853-ad63-a300f0636382-tmp\") pod \"kube-auth-proxy-b99948476-bwncd\" (UID: \"8a2c9e70-f3ac-4853-ad63-a300f0636382\") " pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:18.045873 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:18.045853    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hm8x\" (UniqueName: \"kubernetes.io/projected/8a2c9e70-f3ac-4853-ad63-a300f0636382-kube-api-access-9hm8x\") pod \"kube-auth-proxy-b99948476-bwncd\" (UID: \"8a2c9e70-f3ac-4853-ad63-a300f0636382\") " pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:18.206148 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:18.206115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:18.541876 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:18.541844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a2c9e70-f3ac-4853-ad63-a300f0636382-tls-certs\") pod \"kube-auth-proxy-b99948476-bwncd\" (UID: \"8a2c9e70-f3ac-4853-ad63-a300f0636382\") " pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:18.544346 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:18.544326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a2c9e70-f3ac-4853-ad63-a300f0636382-tls-certs\") pod \"kube-auth-proxy-b99948476-bwncd\" (UID: \"8a2c9e70-f3ac-4853-ad63-a300f0636382\") " pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:18.748209 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:18.748175    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd"
Jul 20 17:59:18.914805 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:18.914753    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b99948476-bwncd"]
Jul 20 17:59:18.917355 ip-10-0-141-126 kubenswrapper[2562]: W0720 17:59:18.917325    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a2c9e70_f3ac_4853_ad63_a300f0636382.slice/crio-201d0d6765a87a71223b1737f7383812941d7546ea9bda8f352193d611761c94 WatchSource:0}: Error finding container 201d0d6765a87a71223b1737f7383812941d7546ea9bda8f352193d611761c94: Status 404 returned error can't find the container with id 201d0d6765a87a71223b1737f7383812941d7546ea9bda8f352193d611761c94
Jul 20 17:59:19.055192 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:19.055157    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd" event={"ID":"8a2c9e70-f3ac-4853-ad63-a300f0636382","Type":"ContainerStarted","Data":"201d0d6765a87a71223b1737f7383812941d7546ea9bda8f352193d611761c94"}
Jul 20 17:59:19.620303 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:19.620257    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:19.761232 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:19.761200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:21.734193 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:21.734155    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:22.071617 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:22.071534    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd" event={"ID":"8a2c9e70-f3ac-4853-ad63-a300f0636382","Type":"ContainerStarted","Data":"e33bd0e233fb47e10e851dd854ed4a0dc5f4b6aca2f35ae39d17d77c4f33950d"}
Jul 20 17:59:22.114108 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:22.114062    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b99948476-bwncd" podStartSLOduration=2.140263313 podStartE2EDuration="5.114046161s" totalImagesPullingTime="2.973782848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 17:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 17:59:22.113448525 +0000 UTC m=+669.485041784" watchObservedRunningTime="2026-07-20 17:59:22.114046161 +0000 UTC m=+669.485639442"
Jul 20 17:59:23.871721 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:23.871686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:24.040412 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:24.040357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:24.188037 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:24.187960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:24.343959 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:24.343933    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:25.130171 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:25.130138    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:25.360371 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:25.360344    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:25.670124 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:25.670092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:25.841470 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:25.841440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:26.042129 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:26.042049    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7974845875-8cr4r"
Jul 20 17:59:26.160968 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:26.160932    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:26.262294 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:26.262260    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 17:59:26.428132 ip-10-0-141-126 kubenswrapper[2562]: I0720 17:59:26.428104    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:13.556520 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:13.556430    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:13.626573 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:13.626522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:13.740409 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:13.740373    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:15.394081 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:15.394032    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:15.498676 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:15.498643    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:43.080309 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:43.080269    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:48.587712 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:48.587678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:49.878565 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:49.878537    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54584cb785-gbqk9"]
Jul 20 18:00:49.880931 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:49.880910    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:49.895421 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:49.895383    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54584cb785-gbqk9"]
Jul 20 18:00:49.952207 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:49.952177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:49.986380 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:49.986346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-service-ca\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:49.986567 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:49.986386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cba5d1a-8b6f-4450-a974-63eec3b89df0-console-oauth-config\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:49.986567 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:49.986479    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9t9f\" (UniqueName: \"kubernetes.io/projected/3cba5d1a-8b6f-4450-a974-63eec3b89df0-kube-api-access-h9t9f\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:49.986567 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:49.986512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cba5d1a-8b6f-4450-a974-63eec3b89df0-console-serving-cert\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:49.986567 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:49.986560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-trusted-ca-bundle\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:49.986723 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:49.986635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-console-config\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:49.986723 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:49.986673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-oauth-serving-cert\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.060181 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.060149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:50.087850 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.087818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-service-ca\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.087850 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.087851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cba5d1a-8b6f-4450-a974-63eec3b89df0-console-oauth-config\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.088033 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.087875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9t9f\" (UniqueName: \"kubernetes.io/projected/3cba5d1a-8b6f-4450-a974-63eec3b89df0-kube-api-access-h9t9f\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.088033 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.087915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cba5d1a-8b6f-4450-a974-63eec3b89df0-console-serving-cert\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.088033 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.087976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-trusted-ca-bundle\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.088033 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.088013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-console-config\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.088228 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.088067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-oauth-serving-cert\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.088766 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.088744    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-console-config\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.088766 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.088762    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-service-ca\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.088902 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.088816    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-oauth-serving-cert\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.089112 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.089088    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cba5d1a-8b6f-4450-a974-63eec3b89df0-trusted-ca-bundle\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.090522 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.090503    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3cba5d1a-8b6f-4450-a974-63eec3b89df0-console-oauth-config\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.090625 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.090593    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3cba5d1a-8b6f-4450-a974-63eec3b89df0-console-serving-cert\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.096184 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.096163    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9t9f\" (UniqueName: \"kubernetes.io/projected/3cba5d1a-8b6f-4450-a974-63eec3b89df0-kube-api-access-h9t9f\") pod \"console-54584cb785-gbqk9\" (UID: \"3cba5d1a-8b6f-4450-a974-63eec3b89df0\") " pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.152045 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.151973    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:50.189567 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.189537    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:00:50.252635 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.252571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:50.332886 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.332862    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54584cb785-gbqk9"]
Jul 20 18:00:50.334944 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:00:50.334914    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cba5d1a_8b6f_4450_a974_63eec3b89df0.slice/crio-4b4bef7d748e92074af3f52abfbbc6acf5c394cec23d91cd65c5c15e6b4a76c2 WatchSource:0}: Error finding container 4b4bef7d748e92074af3f52abfbbc6acf5c394cec23d91cd65c5c15e6b4a76c2: Status 404 returned error can't find the container with id 4b4bef7d748e92074af3f52abfbbc6acf5c394cec23d91cd65c5c15e6b4a76c2
Jul 20 18:00:50.481525 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.481431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54584cb785-gbqk9" event={"ID":"3cba5d1a-8b6f-4450-a974-63eec3b89df0","Type":"ContainerStarted","Data":"9457f6976107df790f3cf0ddb44b1ecc01967be4f6f03cc525753887b27a331d"}
Jul 20 18:00:50.481525 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.481477    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54584cb785-gbqk9" event={"ID":"3cba5d1a-8b6f-4450-a974-63eec3b89df0","Type":"ContainerStarted","Data":"4b4bef7d748e92074af3f52abfbbc6acf5c394cec23d91cd65c5c15e6b4a76c2"}
Jul 20 18:00:50.501556 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.501520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:50.514763 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.514722    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54584cb785-gbqk9" podStartSLOduration=1.514706231 podStartE2EDuration="1.514706231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:00:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:00:50.513167795 +0000 UTC m=+757.884761056" watchObservedRunningTime="2026-07-20 18:00:50.514706231 +0000 UTC m=+757.886299489"
Jul 20 18:00:50.714457 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.714426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:50.827188 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:50.827102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:52.875353 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:52.875320    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:53.149477 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:53.149376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:53.290125 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:53.290093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:55.695936 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:55.695902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:58.100905 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:58.100859    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:58.201335 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:58.201305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:59.648363 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.648330    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"]
Jul 20 18:00:59.652195 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.652176    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"
Jul 20 18:00:59.654984 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.654965    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-559lz\""
Jul 20 18:00:59.655274 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.655237    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 20 18:00:59.655357 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.655305    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 18:00:59.656307 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.656290    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 18:00:59.656372 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.656294    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 20 18:00:59.661244 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.661222    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:59.662500 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.662478    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"]
Jul 20 18:00:59.780999 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.780969    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:00:59.787095 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.787073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/53daaf45-ba03-4b8d-9df0-32811e35a462-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-98q8f\" (UID: \"53daaf45-ba03-4b8d-9df0-32811e35a462\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"
Jul 20 18:00:59.787240 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.787223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/53daaf45-ba03-4b8d-9df0-32811e35a462-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-98q8f\" (UID: \"53daaf45-ba03-4b8d-9df0-32811e35a462\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"
Jul 20 18:00:59.787280 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.787251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs4zf\" (UniqueName: \"kubernetes.io/projected/53daaf45-ba03-4b8d-9df0-32811e35a462-kube-api-access-cs4zf\") pod \"kuadrant-console-plugin-66b5774985-98q8f\" (UID: \"53daaf45-ba03-4b8d-9df0-32811e35a462\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"
Jul 20 18:00:59.888465 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.888430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/53daaf45-ba03-4b8d-9df0-32811e35a462-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-98q8f\" (UID: \"53daaf45-ba03-4b8d-9df0-32811e35a462\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"
Jul 20 18:00:59.888617 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.888474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs4zf\" (UniqueName: \"kubernetes.io/projected/53daaf45-ba03-4b8d-9df0-32811e35a462-kube-api-access-cs4zf\") pod \"kuadrant-console-plugin-66b5774985-98q8f\" (UID: \"53daaf45-ba03-4b8d-9df0-32811e35a462\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"
Jul 20 18:00:59.888617 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.888502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/53daaf45-ba03-4b8d-9df0-32811e35a462-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-98q8f\" (UID: \"53daaf45-ba03-4b8d-9df0-32811e35a462\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"
Jul 20 18:00:59.889156 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.889140    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/53daaf45-ba03-4b8d-9df0-32811e35a462-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-98q8f\" (UID: \"53daaf45-ba03-4b8d-9df0-32811e35a462\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"
Jul 20 18:00:59.891047 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.891029    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/53daaf45-ba03-4b8d-9df0-32811e35a462-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-98q8f\" (UID: \"53daaf45-ba03-4b8d-9df0-32811e35a462\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"
Jul 20 18:00:59.897206 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.897186    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs4zf\" (UniqueName: \"kubernetes.io/projected/53daaf45-ba03-4b8d-9df0-32811e35a462-kube-api-access-cs4zf\") pod \"kuadrant-console-plugin-66b5774985-98q8f\" (UID: \"53daaf45-ba03-4b8d-9df0-32811e35a462\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"
Jul 20 18:00:59.976877 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:00:59.976806    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"
Jul 20 18:01:00.116251 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:00.116230    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f"]
Jul 20 18:01:00.119077 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:01:00.119046    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53daaf45_ba03_4b8d_9df0_32811e35a462.slice/crio-32c82bfab13d92f9933cb86bfb61685769bb72c49e02c7aa76eb19844a1149c6 WatchSource:0}: Error finding container 32c82bfab13d92f9933cb86bfb61685769bb72c49e02c7aa76eb19844a1149c6: Status 404 returned error can't find the container with id 32c82bfab13d92f9933cb86bfb61685769bb72c49e02c7aa76eb19844a1149c6
Jul 20 18:01:00.120537 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:00.120519    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:01:00.190650 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:00.190617    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:01:00.190814 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:00.190674    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:01:00.195445 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:00.195422    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:01:00.529035 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:00.529001    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f" event={"ID":"53daaf45-ba03-4b8d-9df0-32811e35a462","Type":"ContainerStarted","Data":"32c82bfab13d92f9933cb86bfb61685769bb72c49e02c7aa76eb19844a1149c6"}
Jul 20 18:01:00.532975 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:00.532954    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54584cb785-gbqk9"
Jul 20 18:01:00.585870 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:00.585839    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dcb46b894-9t8q7"]
Jul 20 18:01:00.699702 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:00.699674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:01.065159 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:01.065129    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:01.132511 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:01.132476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:05.841434 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:05.841374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:06.683261 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:06.683233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:06.754808 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:06.754774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:09.511433 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:09.511382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:09.993297 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:09.993249    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"]
Jul 20 18:01:10.004135 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:10.004105    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:01:10.006930 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:10.006908    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jftbm\""
Jul 20 18:01:10.014189 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:10.014030    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"]
Jul 20 18:01:10.092023 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:10.091984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7g8d\" (UniqueName: \"kubernetes.io/projected/0231ee25-6097-44e9-9d87-738e0216f873-kube-api-access-q7g8d\") pod \"kuadrant-operator-controller-manager-86878c769f-2khkm\" (UID: \"0231ee25-6097-44e9-9d87-738e0216f873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:01:10.092281 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:10.092033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0231ee25-6097-44e9-9d87-738e0216f873-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2khkm\" (UID: \"0231ee25-6097-44e9-9d87-738e0216f873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:01:10.192988 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:10.192948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7g8d\" (UniqueName: \"kubernetes.io/projected/0231ee25-6097-44e9-9d87-738e0216f873-kube-api-access-q7g8d\") pod \"kuadrant-operator-controller-manager-86878c769f-2khkm\" (UID: \"0231ee25-6097-44e9-9d87-738e0216f873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:01:10.193152 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:10.193000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0231ee25-6097-44e9-9d87-738e0216f873-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2khkm\" (UID: \"0231ee25-6097-44e9-9d87-738e0216f873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:01:10.193456 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:10.193434    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0231ee25-6097-44e9-9d87-738e0216f873-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2khkm\" (UID: \"0231ee25-6097-44e9-9d87-738e0216f873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:01:10.207424 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:10.207379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7g8d\" (UniqueName: \"kubernetes.io/projected/0231ee25-6097-44e9-9d87-738e0216f873-kube-api-access-q7g8d\") pod \"kuadrant-operator-controller-manager-86878c769f-2khkm\" (UID: \"0231ee25-6097-44e9-9d87-738e0216f873\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:01:10.318252 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:10.318157    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:01:10.380201 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:10.380163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:15.492368 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:15.492334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:15.556972 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:15.556940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:16.100027 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:16.099979    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:16.170433 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:16.170380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:21.706167 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:21.706129    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:21.774026 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:21.773992    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:23.614967 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:23.614943    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"]
Jul 20 18:01:23.617218 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:01:23.617194    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0231ee25_6097_44e9_9d87_738e0216f873.slice/crio-bac8b21cbb8f35bba3a95872f6bf31946ef4063176a6367e4c7545108c7f902a WatchSource:0}: Error finding container bac8b21cbb8f35bba3a95872f6bf31946ef4063176a6367e4c7545108c7f902a: Status 404 returned error can't find the container with id bac8b21cbb8f35bba3a95872f6bf31946ef4063176a6367e4c7545108c7f902a
Jul 20 18:01:23.663577 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:23.663540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm" event={"ID":"0231ee25-6097-44e9-9d87-738e0216f873","Type":"ContainerStarted","Data":"bac8b21cbb8f35bba3a95872f6bf31946ef4063176a6367e4c7545108c7f902a"}
Jul 20 18:01:24.670213 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:24.670173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f" event={"ID":"53daaf45-ba03-4b8d-9df0-32811e35a462","Type":"ContainerStarted","Data":"bb3c4cd0f96a279bbbce586d8b130e1739f31b9e67a1d3219cec0de8a00d8838"}
Jul 20 18:01:24.688004 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:24.687951    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98q8f" podStartSLOduration=1.768765461 podStartE2EDuration="25.687935322s" totalImagesPullingTime="23.919169861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:01:24.686404893 +0000 UTC m=+792.057998143" watchObservedRunningTime="2026-07-20 18:01:24.687935322 +0000 UTC m=+792.059528580"
Jul 20 18:01:25.609741 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.609697    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dcb46b894-9t8q7" podUID="462f9cbf-9c36-45ae-a7af-7a308e303adf" containerName="console" containerID="cri-o://0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85" gracePeriod=15
Jul 20 18:01:25.853667 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.853638    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 18:01:25.957384 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.957286    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj5p9\" (UniqueName: \"kubernetes.io/projected/462f9cbf-9c36-45ae-a7af-7a308e303adf-kube-api-access-gj5p9\") pod \"462f9cbf-9c36-45ae-a7af-7a308e303adf\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") "
Jul 20 18:01:25.957384 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.957369    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-service-ca\") pod \"462f9cbf-9c36-45ae-a7af-7a308e303adf\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") "
Jul 20 18:01:25.957653 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.957441    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-oauth-config\") pod \"462f9cbf-9c36-45ae-a7af-7a308e303adf\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") "
Jul 20 18:01:25.957653 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.957472    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-oauth-serving-cert\") pod \"462f9cbf-9c36-45ae-a7af-7a308e303adf\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") "
Jul 20 18:01:25.957653 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.957540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-serving-cert\") pod \"462f9cbf-9c36-45ae-a7af-7a308e303adf\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") "
Jul 20 18:01:25.957653 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.957573    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-config\") pod \"462f9cbf-9c36-45ae-a7af-7a308e303adf\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") "
Jul 20 18:01:25.957653 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.957601    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-trusted-ca-bundle\") pod \"462f9cbf-9c36-45ae-a7af-7a308e303adf\" (UID: \"462f9cbf-9c36-45ae-a7af-7a308e303adf\") "
Jul 20 18:01:25.957885 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.957798    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-service-ca" (OuterVolumeSpecName: "service-ca") pod "462f9cbf-9c36-45ae-a7af-7a308e303adf" (UID: "462f9cbf-9c36-45ae-a7af-7a308e303adf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:01:25.958000 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.957958    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "462f9cbf-9c36-45ae-a7af-7a308e303adf" (UID: "462f9cbf-9c36-45ae-a7af-7a308e303adf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:01:25.958131 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.958055    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:01:25.958131 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.958069    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-config" (OuterVolumeSpecName: "console-config") pod "462f9cbf-9c36-45ae-a7af-7a308e303adf" (UID: "462f9cbf-9c36-45ae-a7af-7a308e303adf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:01:25.958131 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.958078    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-oauth-serving-cert\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:01:25.958267 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.958167    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "462f9cbf-9c36-45ae-a7af-7a308e303adf" (UID: "462f9cbf-9c36-45ae-a7af-7a308e303adf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:01:25.959748 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.959717    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/462f9cbf-9c36-45ae-a7af-7a308e303adf-kube-api-access-gj5p9" (OuterVolumeSpecName: "kube-api-access-gj5p9") pod "462f9cbf-9c36-45ae-a7af-7a308e303adf" (UID: "462f9cbf-9c36-45ae-a7af-7a308e303adf"). InnerVolumeSpecName "kube-api-access-gj5p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:01:25.959748 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.959739    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "462f9cbf-9c36-45ae-a7af-7a308e303adf" (UID: "462f9cbf-9c36-45ae-a7af-7a308e303adf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:01:25.959857 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:25.959761    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "462f9cbf-9c36-45ae-a7af-7a308e303adf" (UID: "462f9cbf-9c36-45ae-a7af-7a308e303adf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:01:26.059221 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.059190    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj5p9\" (UniqueName: \"kubernetes.io/projected/462f9cbf-9c36-45ae-a7af-7a308e303adf-kube-api-access-gj5p9\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:01:26.059221 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.059219    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-oauth-config\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:01:26.059221 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.059231    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-serving-cert\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:01:26.059473 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.059240    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-console-config\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:01:26.059473 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.059251    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/462f9cbf-9c36-45ae-a7af-7a308e303adf-trusted-ca-bundle\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:01:26.680326 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.680291    2562 generic.go:356] "Generic (PLEG): container finished" podID="462f9cbf-9c36-45ae-a7af-7a308e303adf" containerID="0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85" exitCode=0
Jul 20 18:01:26.680546 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.680338    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcb46b894-9t8q7"
Jul 20 18:01:26.680546 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.680401    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcb46b894-9t8q7" event={"ID":"462f9cbf-9c36-45ae-a7af-7a308e303adf","Type":"ContainerDied","Data":"0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85"}
Jul 20 18:01:26.680546 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.680451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcb46b894-9t8q7" event={"ID":"462f9cbf-9c36-45ae-a7af-7a308e303adf","Type":"ContainerDied","Data":"3442dff974e51d11349ca6d36b8d6fb2bbe9efbd8518fc830128ca5648bed1ee"}
Jul 20 18:01:26.680546 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.680472    2562 scope.go:117] "RemoveContainer" containerID="0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85"
Jul 20 18:01:26.690223 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.690208    2562 scope.go:117] "RemoveContainer" containerID="0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85"
Jul 20 18:01:26.690507 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:01:26.690489    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85\": container with ID starting with 0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85 not found: ID does not exist" containerID="0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85"
Jul 20 18:01:26.690581 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.690518    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85"} err="failed to get container status \"0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85\": rpc error: code = NotFound desc = could not find container \"0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85\": container with ID starting with 0843d4425c7074f0aadc661e5e7bc2dd2b13a20facfdd05907da699dc2c9bb85 not found: ID does not exist"
Jul 20 18:01:26.702749 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.702726    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dcb46b894-9t8q7"]
Jul 20 18:01:26.708450 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:26.708431    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dcb46b894-9t8q7"]
Jul 20 18:01:27.180208 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:27.180178    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="462f9cbf-9c36-45ae-a7af-7a308e303adf" path="/var/lib/kubelet/pods/462f9cbf-9c36-45ae-a7af-7a308e303adf/volumes"
Jul 20 18:01:28.407802 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:28.407764    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:28.508914 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:28.508879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:30.863507 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:30.863474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:30.962893 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:30.962860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:33.720637 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:33.720525    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm" event={"ID":"0231ee25-6097-44e9-9d87-738e0216f873","Type":"ContainerStarted","Data":"97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c"}
Jul 20 18:01:33.720637 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:33.720623    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:01:33.743545 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:33.743492    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm" podStartSLOduration=14.943267283 podStartE2EDuration="24.743476078s" totalImagesPullingTime="9.800208795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:01:33.740793116 +0000 UTC m=+801.112386375" watchObservedRunningTime="2026-07-20 18:01:33.743476078 +0000 UTC m=+801.115069338"
Jul 20 18:01:37.870096 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:37.870064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:37.970399 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:37.970366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:01:44.728189 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:01:44.728154    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:02:01.289452 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:01.289416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:01.465318 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:01.465287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:03.127235 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:03.127202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:03.267471 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:03.267439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:03.446147 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:03.446071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:04.140901 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:04.140871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:04.241408 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:04.241356    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:24.310059 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:24.310024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:24.410471 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:24.410408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:24.852911 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:24.852880    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:37.521214 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:37.521179    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:38.132129 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:38.132086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:47.335160 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:47.335126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:47.428790 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:47.428753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:47.532107 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:47.532077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:50.668921 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:50.668822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:50.760911 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:50.760880    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:02:51.830531 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:02:51.830502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:13.070552 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:13.070475    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:03:13.071322 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:13.071297    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:03:23.319419 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:23.319377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:23.957796 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:23.957760    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"]
Jul 20 18:03:23.958153 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:23.958141    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="462f9cbf-9c36-45ae-a7af-7a308e303adf" containerName="console"
Jul 20 18:03:23.958199 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:23.958155    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="462f9cbf-9c36-45ae-a7af-7a308e303adf" containerName="console"
Jul 20 18:03:23.958233 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:23.958224    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="462f9cbf-9c36-45ae-a7af-7a308e303adf" containerName="console"
Jul 20 18:03:23.960474 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:23.960458    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:23.963134 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:23.963114    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 18:03:23.963249 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:23.963238    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-chbc2\""
Jul 20 18:03:23.963306 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:23.963289    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 18:03:23.964385 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:23.964367    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 18:03:23.976656 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:23.976634    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"]
Jul 20 18:03:24.083207 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:24.083175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d89606c9-06ab-4a75-b828-06b1d21d8c60-maas-api-tls\") pod \"maas-api-6b976987d9-g8rhc\" (UID: \"d89606c9-06ab-4a75-b828-06b1d21d8c60\") " pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:24.083447 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:24.083265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrmsd\" (UniqueName: \"kubernetes.io/projected/d89606c9-06ab-4a75-b828-06b1d21d8c60-kube-api-access-hrmsd\") pod \"maas-api-6b976987d9-g8rhc\" (UID: \"d89606c9-06ab-4a75-b828-06b1d21d8c60\") " pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:24.083447 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:24.083317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d89606c9-06ab-4a75-b828-06b1d21d8c60-openshift-service-ca\") pod \"maas-api-6b976987d9-g8rhc\" (UID: \"d89606c9-06ab-4a75-b828-06b1d21d8c60\") " pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:24.183993 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:24.183960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrmsd\" (UniqueName: \"kubernetes.io/projected/d89606c9-06ab-4a75-b828-06b1d21d8c60-kube-api-access-hrmsd\") pod \"maas-api-6b976987d9-g8rhc\" (UID: \"d89606c9-06ab-4a75-b828-06b1d21d8c60\") " pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:24.184161 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:24.184007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d89606c9-06ab-4a75-b828-06b1d21d8c60-openshift-service-ca\") pod \"maas-api-6b976987d9-g8rhc\" (UID: \"d89606c9-06ab-4a75-b828-06b1d21d8c60\") " pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:24.184161 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:24.184043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d89606c9-06ab-4a75-b828-06b1d21d8c60-maas-api-tls\") pod \"maas-api-6b976987d9-g8rhc\" (UID: \"d89606c9-06ab-4a75-b828-06b1d21d8c60\") " pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:24.184672 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:24.184652    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d89606c9-06ab-4a75-b828-06b1d21d8c60-openshift-service-ca\") pod \"maas-api-6b976987d9-g8rhc\" (UID: \"d89606c9-06ab-4a75-b828-06b1d21d8c60\") " pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:24.186616 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:24.186597    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d89606c9-06ab-4a75-b828-06b1d21d8c60-maas-api-tls\") pod \"maas-api-6b976987d9-g8rhc\" (UID: \"d89606c9-06ab-4a75-b828-06b1d21d8c60\") " pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:24.202846 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:24.202815    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrmsd\" (UniqueName: \"kubernetes.io/projected/d89606c9-06ab-4a75-b828-06b1d21d8c60-kube-api-access-hrmsd\") pod \"maas-api-6b976987d9-g8rhc\" (UID: \"d89606c9-06ab-4a75-b828-06b1d21d8c60\") " pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:24.270794 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:24.270712    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:24.416445 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:24.416421    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"]
Jul 20 18:03:24.418898 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:03:24.418866    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89606c9_06ab_4a75_b828_06b1d21d8c60.slice/crio-9ad5c0e3f2e406970e96719a2539207af050a79dba515e594d50c41d7aeb1b1f WatchSource:0}: Error finding container 9ad5c0e3f2e406970e96719a2539207af050a79dba515e594d50c41d7aeb1b1f: Status 404 returned error can't find the container with id 9ad5c0e3f2e406970e96719a2539207af050a79dba515e594d50c41d7aeb1b1f
Jul 20 18:03:25.243848 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:25.243805    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc" event={"ID":"d89606c9-06ab-4a75-b828-06b1d21d8c60","Type":"ContainerStarted","Data":"9ad5c0e3f2e406970e96719a2539207af050a79dba515e594d50c41d7aeb1b1f"}
Jul 20 18:03:25.830789 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:25.830750    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:25.935994 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:25.935958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:27.255585 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:27.255554    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc" event={"ID":"d89606c9-06ab-4a75-b828-06b1d21d8c60","Type":"ContainerStarted","Data":"079e50e22326cd14335ef603dd8ee5a2cd0cebafa11696335228117d55ce4368"}
Jul 20 18:03:27.256000 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:27.255673    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:27.274196 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:27.274146    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc" podStartSLOduration=2.032490332 podStartE2EDuration="4.274131278s" totalImagesPullingTime="2.241640946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:03:27.272818778 +0000 UTC m=+914.644412038" watchObservedRunningTime="2026-07-20 18:03:27.274131278 +0000 UTC m=+914.645724537"
Jul 20 18:03:33.266387 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:33.266358    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b976987d9-g8rhc"
Jul 20 18:03:34.295061 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:34.295029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:34.406576 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:34.406542    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:44.024849 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:44.024815    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:03:55.842457 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:03:55.842422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:01.780744 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.780709    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"]
Jul 20 18:04:01.784757 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.784735    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:01.787753 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.787718    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 18:04:01.787871 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.787780    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 18:04:01.788813 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.788795    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 20 18:04:01.788911 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.788801    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kpjkh\""
Jul 20 18:04:01.793911 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.793885    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"]
Jul 20 18:04:01.809760 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.809729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:01.946614 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.946578    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5v62\" (UniqueName: \"kubernetes.io/projected/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-kube-api-access-t5v62\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:01.946789 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.946625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:01.946789 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.946650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:01.946789 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.946763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:01.946925 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.946807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:01.946925 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:01.946831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.048133 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.048045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.048133 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.048097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.048133 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.048117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.048442 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.048160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5v62\" (UniqueName: \"kubernetes.io/projected/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-kube-api-access-t5v62\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.048442 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.048186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.048442 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.048200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.048612 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.048542    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.048667 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.048619    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.048667 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.048632    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.050723 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.050691    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.050913 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.050896    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.071634 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.071605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5v62\" (UniqueName: \"kubernetes.io/projected/ca4d0b2e-6f7c-438d-bc75-cc47142bfab6-kube-api-access-t5v62\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2pccs\" (UID: \"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.095693 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.095671    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:02.229768 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.229743    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"]
Jul 20 18:04:02.232478 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:04:02.232449    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4d0b2e_6f7c_438d_bc75_cc47142bfab6.slice/crio-6d8453c62fc783e48485e4f9bb29562f9e72b254fce060eda00fc95a4929a9c0 WatchSource:0}: Error finding container 6d8453c62fc783e48485e4f9bb29562f9e72b254fce060eda00fc95a4929a9c0: Status 404 returned error can't find the container with id 6d8453c62fc783e48485e4f9bb29562f9e72b254fce060eda00fc95a4929a9c0
Jul 20 18:04:02.429888 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:02.429857    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs" event={"ID":"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6","Type":"ContainerStarted","Data":"6d8453c62fc783e48485e4f9bb29562f9e72b254fce060eda00fc95a4929a9c0"}
Jul 20 18:04:04.442242 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:04.442207    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs" event={"ID":"ca4d0b2e-6f7c-438d-bc75-cc47142bfab6","Type":"ContainerStarted","Data":"bbd614cc519f16f24ff1b601632c266cfbf9d8e745f0bcdec17618a5118b9b64"}
Jul 20 18:04:04.460976 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:04.460935    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs" podStartSLOduration=2.273734347 podStartE2EDuration="3.460916313s" totalImagesPullingTime="1.187181966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:04:04.460757761 +0000 UTC m=+951.832351021" watchObservedRunningTime="2026-07-20 18:04:04.460916313 +0000 UTC m=+951.832509625"
Jul 20 18:04:12.096579 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:12.096550    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:12.097012 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:12.096831    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:12.109382 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:12.109359    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:12.490290 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:12.490202    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2pccs"
Jul 20 18:04:15.020547 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:15.020503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:22.323353 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:22.323301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:33.797216 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:33.797131    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"]
Jul 20 18:04:33.799982 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:33.799968    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:33.802997 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:33.802976    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 20 18:04:33.815315 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:33.815290    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"]
Jul 20 18:04:33.837101 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:33.837070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:04:33.957779 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:33.957743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:33.957779 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:33.957784    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:33.957992 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:33.957843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgfjh\" (UniqueName: \"kubernetes.io/projected/f12596dd-4156-4a89-9412-4afed078f30d-kube-api-access-jgfjh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:33.957992 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:33.957864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12596dd-4156-4a89-9412-4afed078f30d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:33.958061 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:33.957983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:33.958061 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:33.958012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.058629 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.058541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.058629 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.058591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.058831 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.058658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgfjh\" (UniqueName: \"kubernetes.io/projected/f12596dd-4156-4a89-9412-4afed078f30d-kube-api-access-jgfjh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.058831 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.058691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12596dd-4156-4a89-9412-4afed078f30d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.058831 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.058764    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.058831 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.058790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.059066 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.059042    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.059131 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.059099    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.059131 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.059125    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.060938 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.060913    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f12596dd-4156-4a89-9412-4afed078f30d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.061212 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.061195    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f12596dd-4156-4a89-9412-4afed078f30d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.078969 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.078939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgfjh\" (UniqueName: \"kubernetes.io/projected/f12596dd-4156-4a89-9412-4afed078f30d-kube-api-access-jgfjh\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p28wt\" (UID: \"f12596dd-4156-4a89-9412-4afed078f30d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.108953 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.108923    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:34.246259 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.246135    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"]
Jul 20 18:04:34.248548 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:04:34.248517    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf12596dd_4156_4a89_9412_4afed078f30d.slice/crio-afed525f354d1bf7906337fa98a2115f6585c4936a3810da4496356887526f7a WatchSource:0}: Error finding container afed525f354d1bf7906337fa98a2115f6585c4936a3810da4496356887526f7a: Status 404 returned error can't find the container with id afed525f354d1bf7906337fa98a2115f6585c4936a3810da4496356887526f7a
Jul 20 18:04:34.584108 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.584072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt" event={"ID":"f12596dd-4156-4a89-9412-4afed078f30d","Type":"ContainerStarted","Data":"a78aad0c27f3744ac7bdd0f9de239e4a82a0e8c5ffda65eef51ed4c991b71b46"}
Jul 20 18:04:34.584272 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.584123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt" event={"ID":"f12596dd-4156-4a89-9412-4afed078f30d","Type":"ContainerStarted","Data":"afed525f354d1bf7906337fa98a2115f6585c4936a3810da4496356887526f7a"}
Jul 20 18:04:34.623575 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:34.623523    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt" podStartSLOduration=1.413021306 podStartE2EDuration="1.623507206s" totalImagesPullingTime="210.4859ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:04:34.622293474 +0000 UTC m=+981.993886734" watchObservedRunningTime="2026-07-20 18:04:34.623507206 +0000 UTC m=+981.995100463"
Jul 20 18:04:44.109913 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:44.109871    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:44.110293 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:44.109929    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:44.122344 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:44.122319    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:04:44.647808 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:04:44.647780    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p28wt"
Jul 20 18:05:00.307528 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:05:00.307497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:29.598293 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:05:29.598252    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:29.685876 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:05:29.685843    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:30.796675 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:05:30.796632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:05:30.886707 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:05:30.886671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:03.345948 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:06:03.345914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:06:56.419230 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:06:56.419190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:12.155760 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:07:12.155719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:12.214320 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:07:12.214288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:19.560428 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:07:19.560366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:38.130198 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:07:38.130118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:39.353613 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:07:39.353578    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:07:57.723476 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:07:57.723445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:13.103919 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:08:13.103892    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:08:13.104878 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:08:13.104856    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:08:15.079872 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:08:15.079835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:15.177418 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:08:15.177368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:15.304957 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:08:15.304927    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:21.087742 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:08:21.087711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:21.192049 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:08:21.192019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:21.297586 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:08:21.297548    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:21.585687 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:08:21.585608    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:27.403054 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:08:27.403021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:08:27.464764 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:08:27.464736    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:12:17.698075 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:17.697992    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"]
Jul 20 18:12:17.698626 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:17.698216    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm" podUID="0231ee25-6097-44e9-9d87-738e0216f873" containerName="manager" containerID="cri-o://97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c" gracePeriod=10
Jul 20 18:12:20.463278 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.463249    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:12:20.495432 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.495384    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7g8d\" (UniqueName: \"kubernetes.io/projected/0231ee25-6097-44e9-9d87-738e0216f873-kube-api-access-q7g8d\") pod \"0231ee25-6097-44e9-9d87-738e0216f873\" (UID: \"0231ee25-6097-44e9-9d87-738e0216f873\") "
Jul 20 18:12:20.495610 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.495468    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0231ee25-6097-44e9-9d87-738e0216f873-extensions-socket-volume\") pod \"0231ee25-6097-44e9-9d87-738e0216f873\" (UID: \"0231ee25-6097-44e9-9d87-738e0216f873\") "
Jul 20 18:12:20.495974 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.495949    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0231ee25-6097-44e9-9d87-738e0216f873-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0231ee25-6097-44e9-9d87-738e0216f873" (UID: "0231ee25-6097-44e9-9d87-738e0216f873"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 18:12:20.497964 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.497933    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0231ee25-6097-44e9-9d87-738e0216f873-kube-api-access-q7g8d" (OuterVolumeSpecName: "kube-api-access-q7g8d") pod "0231ee25-6097-44e9-9d87-738e0216f873" (UID: "0231ee25-6097-44e9-9d87-738e0216f873"). InnerVolumeSpecName "kube-api-access-q7g8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:12:20.596520 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.596495    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7g8d\" (UniqueName: \"kubernetes.io/projected/0231ee25-6097-44e9-9d87-738e0216f873-kube-api-access-q7g8d\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:12:20.596520 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.596519    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0231ee25-6097-44e9-9d87-738e0216f873-extensions-socket-volume\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:12:20.888580 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.888482    2562 generic.go:356] "Generic (PLEG): container finished" podID="0231ee25-6097-44e9-9d87-738e0216f873" containerID="97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c" exitCode=0
Jul 20 18:12:20.888580 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.888528    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"
Jul 20 18:12:20.888580 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.888528    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm" event={"ID":"0231ee25-6097-44e9-9d87-738e0216f873","Type":"ContainerDied","Data":"97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c"}
Jul 20 18:12:20.888852 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.888624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm" event={"ID":"0231ee25-6097-44e9-9d87-738e0216f873","Type":"ContainerDied","Data":"bac8b21cbb8f35bba3a95872f6bf31946ef4063176a6367e4c7545108c7f902a"}
Jul 20 18:12:20.888852 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.888656    2562 scope.go:117] "RemoveContainer" containerID="97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c"
Jul 20 18:12:20.899011 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.898987    2562 scope.go:117] "RemoveContainer" containerID="97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c"
Jul 20 18:12:20.899323 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:12:20.899297    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c\": container with ID starting with 97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c not found: ID does not exist" containerID="97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c"
Jul 20 18:12:20.899444 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.899334    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c"} err="failed to get container status \"97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c\": rpc error: code = NotFound desc = could not find container \"97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c\": container with ID starting with 97a91ff0e6b8f271d7102fb518a9f1c795970156d3c7f74cbc9396f9ce15a97c not found: ID does not exist"
Jul 20 18:12:20.915496 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.915466    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"]
Jul 20 18:12:20.924871 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:20.924843    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2khkm"]
Jul 20 18:12:21.180719 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:12:21.180637    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0231ee25-6097-44e9-9d87-738e0216f873" path="/var/lib/kubelet/pods/0231ee25-6097-44e9-9d87-738e0216f873/volumes"
Jul 20 18:13:13.144707 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:13.144681    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:13:13.147713 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:13.147692    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:13:18.881441 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:18.881383    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"]
Jul 20 18:13:18.881821 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:18.881802    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0231ee25-6097-44e9-9d87-738e0216f873" containerName="manager"
Jul 20 18:13:18.881821 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:18.881812    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0231ee25-6097-44e9-9d87-738e0216f873" containerName="manager"
Jul 20 18:13:18.881891 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:18.881881    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0231ee25-6097-44e9-9d87-738e0216f873" containerName="manager"
Jul 20 18:13:18.885077 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:18.885061    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"
Jul 20 18:13:18.888720 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:18.888702    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jftbm\""
Jul 20 18:13:18.907669 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:18.907646    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"]
Jul 20 18:13:18.944270 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:18.944240    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afce5815-e25c-4021-86dd-b9d749addc50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qhfsq\" (UID: \"afce5815-e25c-4021-86dd-b9d749addc50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"
Jul 20 18:13:18.944432 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:18.944298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4xm9\" (UniqueName: \"kubernetes.io/projected/afce5815-e25c-4021-86dd-b9d749addc50-kube-api-access-f4xm9\") pod \"kuadrant-operator-controller-manager-86878c769f-qhfsq\" (UID: \"afce5815-e25c-4021-86dd-b9d749addc50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"
Jul 20 18:13:19.045334 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:19.045300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4xm9\" (UniqueName: \"kubernetes.io/projected/afce5815-e25c-4021-86dd-b9d749addc50-kube-api-access-f4xm9\") pod \"kuadrant-operator-controller-manager-86878c769f-qhfsq\" (UID: \"afce5815-e25c-4021-86dd-b9d749addc50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"
Jul 20 18:13:19.045505 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:19.045414    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afce5815-e25c-4021-86dd-b9d749addc50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qhfsq\" (UID: \"afce5815-e25c-4021-86dd-b9d749addc50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"
Jul 20 18:13:19.045841 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:19.045824    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/afce5815-e25c-4021-86dd-b9d749addc50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qhfsq\" (UID: \"afce5815-e25c-4021-86dd-b9d749addc50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"
Jul 20 18:13:19.053893 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:19.053864    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4xm9\" (UniqueName: \"kubernetes.io/projected/afce5815-e25c-4021-86dd-b9d749addc50-kube-api-access-f4xm9\") pod \"kuadrant-operator-controller-manager-86878c769f-qhfsq\" (UID: \"afce5815-e25c-4021-86dd-b9d749addc50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"
Jul 20 18:13:19.195604 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:19.195522    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"
Jul 20 18:13:19.343025 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:19.343002    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"]
Jul 20 18:13:19.345505 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:13:19.345474    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafce5815_e25c_4021_86dd_b9d749addc50.slice/crio-b13a80488c1f05519cb18e6ed21ba873d98190b05363b9f05b3a176126a81378 WatchSource:0}: Error finding container b13a80488c1f05519cb18e6ed21ba873d98190b05363b9f05b3a176126a81378: Status 404 returned error can't find the container with id b13a80488c1f05519cb18e6ed21ba873d98190b05363b9f05b3a176126a81378
Jul 20 18:13:20.170144 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:20.170108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq" event={"ID":"afce5815-e25c-4021-86dd-b9d749addc50","Type":"ContainerStarted","Data":"d2b1645526a6b9419a3902520911b1462534e8a965a1cc35cf46feb72a29576d"}
Jul 20 18:13:20.170596 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:20.170162    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq" event={"ID":"afce5815-e25c-4021-86dd-b9d749addc50","Type":"ContainerStarted","Data":"b13a80488c1f05519cb18e6ed21ba873d98190b05363b9f05b3a176126a81378"}
Jul 20 18:13:20.170596 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:20.170190    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"
Jul 20 18:13:20.195569 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:20.195516    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq" podStartSLOduration=2.195499955 podStartE2EDuration="2.195499955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:13:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:13:20.192548458 +0000 UTC m=+1507.564141719" watchObservedRunningTime="2026-07-20 18:13:20.195499955 +0000 UTC m=+1507.567093215"
Jul 20 18:13:23.872761 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:23.872726    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:13:31.180321 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:31.180295    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhfsq"
Jul 20 18:13:36.644801 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:13:36.644704    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:15:00.152687 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:00.152650    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq"]
Jul 20 18:15:00.156235 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:00.156214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq"
Jul 20 18:15:00.161374 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:00.161354    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:15:00.166057 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:00.166037    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq"
Jul 20 18:15:00.169417 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:00.169089    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq"]
Jul 20 18:15:00.307154 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:00.307094    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq"]
Jul 20 18:15:00.309436 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:15:00.309375    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7007205_3d05_4e57_a539_b09163f9d2e3.slice/crio-7bdde23a5a43aa510af28efafec475002f8094454ebcebda1d7ca469052f2a1f WatchSource:0}: Error finding container 7bdde23a5a43aa510af28efafec475002f8094454ebcebda1d7ca469052f2a1f: Status 404 returned error can't find the container with id 7bdde23a5a43aa510af28efafec475002f8094454ebcebda1d7ca469052f2a1f
Jul 20 18:15:00.311494 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:00.311478    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:15:00.667158 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:00.667126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq" event={"ID":"e7007205-3d05-4e57-a539-b09163f9d2e3","Type":"ContainerStarted","Data":"7bdde23a5a43aa510af28efafec475002f8094454ebcebda1d7ca469052f2a1f"}
Jul 20 18:15:03.685148 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:03.685067    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq" event={"ID":"e7007205-3d05-4e57-a539-b09163f9d2e3","Type":"ContainerStarted","Data":"3aad1a22e996eb233d91691b3078d4d374740b3250d1c3402a9fd6f8c7af1a69"}
Jul 20 18:15:03.704150 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:03.704102    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq" podStartSLOduration=1.108159554 podStartE2EDuration="3.70408711s" totalImagesPullingTime="2.595927556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:15:03.703342614 +0000 UTC m=+1611.074935876" watchObservedRunningTime="2026-07-20 18:15:03.70408711 +0000 UTC m=+1611.075680368"
Jul 20 18:15:04.692382 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:04.692349    2562 generic.go:356] "Generic (PLEG): container finished" podID="e7007205-3d05-4e57-a539-b09163f9d2e3" containerID="3aad1a22e996eb233d91691b3078d4d374740b3250d1c3402a9fd6f8c7af1a69" exitCode=0
Jul 20 18:15:04.692787 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:04.692434    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq" event={"ID":"e7007205-3d05-4e57-a539-b09163f9d2e3","Type":"ContainerDied","Data":"3aad1a22e996eb233d91691b3078d4d374740b3250d1c3402a9fd6f8c7af1a69"}
Jul 20 18:15:05.833560 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:05.833527    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq"
Jul 20 18:15:06.703094 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:06.703057    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq"
Jul 20 18:15:06.703262 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:06.703103    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742855-jrnkq" event={"ID":"e7007205-3d05-4e57-a539-b09163f9d2e3","Type":"ContainerDied","Data":"7bdde23a5a43aa510af28efafec475002f8094454ebcebda1d7ca469052f2a1f"}
Jul 20 18:15:06.703262 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:06.703154    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bdde23a5a43aa510af28efafec475002f8094454ebcebda1d7ca469052f2a1f"
Jul 20 18:15:27.121731 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:27.121672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:15:56.552708 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:15:56.552668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:16:02.744943 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:16:02.744905    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:16:09.303263 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:16:09.303229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:16:34.556037 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:16:34.555940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:16:35.636767 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:16:35.636728    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:16:42.285422 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:16:42.285374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:18:13.187088 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:18:13.187057    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:18:13.189076 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:18:13.189058    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:19:45.115718 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:19:45.115642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:19:50.461228 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:19:50.461195    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:19:58.699561 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:19:58.699522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:04.304784 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:04.304754    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:07.375170 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:07.375137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:07.472954 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:07.472924    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:07.821251 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:07.821171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:13.573190 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:13.573158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:13.671712 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:13.671669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:13.808358 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:13.808310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:14.127277 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:14.127245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:14.523071 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:14.522987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:16.619499 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.619468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:16.700631 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.700601    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"]
Jul 20 18:20:16.701012 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.700999    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7007205-3d05-4e57-a539-b09163f9d2e3" containerName="cleanup"
Jul 20 18:20:16.701066 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.701013    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7007205-3d05-4e57-a539-b09163f9d2e3" containerName="cleanup"
Jul 20 18:20:16.701122 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.701079    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7007205-3d05-4e57-a539-b09163f9d2e3" containerName="cleanup"
Jul 20 18:20:16.704220 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.704202    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:16.707621 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.707599    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-337dced0-serving-cert\""
Jul 20 18:20:16.715804 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.715782    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:16.716649 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.716629    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"]
Jul 20 18:20:16.792643 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.792601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s94m\" (UniqueName: \"kubernetes.io/projected/00e093e3-d754-41c1-b069-b9253fef5728-kube-api-access-9s94m\") pod \"maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:16.792838 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.792727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e093e3-d754-41c1-b069-b9253fef5728-openshift-service-ca\") pod \"maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:16.792838 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.792780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e093e3-d754-41c1-b069-b9253fef5728-maas-api-tls\") pod \"maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:16.893830 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.893735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e093e3-d754-41c1-b069-b9253fef5728-maas-api-tls\") pod \"maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:16.893830 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.893787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s94m\" (UniqueName: \"kubernetes.io/projected/00e093e3-d754-41c1-b069-b9253fef5728-kube-api-access-9s94m\") pod \"maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:16.894067 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.893863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e093e3-d754-41c1-b069-b9253fef5728-openshift-service-ca\") pod \"maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:16.894067 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:20:16.893918    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-serving-cert: secret "maas-api-e2e-ait-337dced0-serving-cert" not found
Jul 20 18:20:16.894067 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:20:16.893999    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e093e3-d754-41c1-b069-b9253fef5728-maas-api-tls podName:00e093e3-d754-41c1-b069-b9253fef5728 nodeName:}" failed. No retries permitted until 2026-07-20 18:20:17.393978165 +0000 UTC m=+1924.765571425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/00e093e3-d754-41c1-b069-b9253fef5728-maas-api-tls") pod "maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g" (UID: "00e093e3-d754-41c1-b069-b9253fef5728") : secret "maas-api-e2e-ait-337dced0-serving-cert" not found
Jul 20 18:20:16.894530 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.894513    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e093e3-d754-41c1-b069-b9253fef5728-openshift-service-ca\") pod \"maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:16.919526 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:16.919499    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s94m\" (UniqueName: \"kubernetes.io/projected/00e093e3-d754-41c1-b069-b9253fef5728-kube-api-access-9s94m\") pod \"maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:17.032996 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:17.032962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:17.230621 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:17.230521    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:17.398773 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:17.398728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e093e3-d754-41c1-b069-b9253fef5728-maas-api-tls\") pod \"maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:17.401254 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:17.401236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e093e3-d754-41c1-b069-b9253fef5728-maas-api-tls\") pod \"maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:17.615905 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:17.615878    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:17.643897 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:17.643856    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:17.774123 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:17.774086    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"]
Jul 20 18:20:17.775447 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:20:17.775377    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e093e3_d754_41c1_b069_b9253fef5728.slice/crio-96842279a654988ba2dbe07e7cf8bbce95e71361356e89e186ec48c1bd885e11 WatchSource:0}: Error finding container 96842279a654988ba2dbe07e7cf8bbce95e71361356e89e186ec48c1bd885e11: Status 404 returned error can't find the container with id 96842279a654988ba2dbe07e7cf8bbce95e71361356e89e186ec48c1bd885e11
Jul 20 18:20:17.776836 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:17.776818    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:20:17.825042 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:17.825014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:18.248274 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:18.248237    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g" event={"ID":"00e093e3-d754-41c1-b069-b9253fef5728","Type":"ContainerStarted","Data":"96842279a654988ba2dbe07e7cf8bbce95e71361356e89e186ec48c1bd885e11"}
Jul 20 18:20:19.254728 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:19.254692    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g" event={"ID":"00e093e3-d754-41c1-b069-b9253fef5728","Type":"ContainerStarted","Data":"3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1"}
Jul 20 18:20:19.255167 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:19.254749    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:19.278290 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:19.278239    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g" podStartSLOduration=2.58835256 podStartE2EDuration="3.278222988s" totalImagesPullingTime="689.870428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:20:19.27691196 +0000 UTC m=+1926.648505221" watchObservedRunningTime="2026-07-20 18:20:19.278222988 +0000 UTC m=+1926.649816246"
Jul 20 18:20:25.264485 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:25.264455    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:42.224993 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:42.224959    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"]
Jul 20 18:20:42.228483 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:42.228468    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"
Jul 20 18:20:42.231124 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:42.231105    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:20:42.237940 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:42.237842    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"]
Jul 20 18:20:42.339117 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:42.339083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8daaf8d3-b4e5-4021-af68-19d76a5b1b23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-337dced0-k8l58\" (UID: \"8daaf8d3-b4e5-4021-af68-19d76a5b1b23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"
Jul 20 18:20:42.440433 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:42.440382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8daaf8d3-b4e5-4021-af68-19d76a5b1b23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-337dced0-k8l58\" (UID: \"8daaf8d3-b4e5-4021-af68-19d76a5b1b23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"
Jul 20 18:20:42.441000 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:42.440980    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8daaf8d3-b4e5-4021-af68-19d76a5b1b23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-337dced0-k8l58\" (UID: \"8daaf8d3-b4e5-4021-af68-19d76a5b1b23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"
Jul 20 18:20:42.540507 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:42.540418    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"
Jul 20 18:20:42.676376 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:42.676354    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"]
Jul 20 18:20:42.678543 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:20:42.678516    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8daaf8d3_b4e5_4021_af68_19d76a5b1b23.slice/crio-812abfadd05f66d8afc77216d8c779bae4f23abad82ca3479223e1f20c5ebc42 WatchSource:0}: Error finding container 812abfadd05f66d8afc77216d8c779bae4f23abad82ca3479223e1f20c5ebc42: Status 404 returned error can't find the container with id 812abfadd05f66d8afc77216d8c779bae4f23abad82ca3479223e1f20c5ebc42
Jul 20 18:20:43.378335 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:43.378304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58" event={"ID":"8daaf8d3-b4e5-4021-af68-19d76a5b1b23","Type":"ContainerStarted","Data":"ba36f917dcd55a84ebb832f4f1008b52f1825e41e0d92ead78f3455556f0ae69"}
Jul 20 18:20:43.378737 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:43.378354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58" event={"ID":"8daaf8d3-b4e5-4021-af68-19d76a5b1b23","Type":"ContainerStarted","Data":"812abfadd05f66d8afc77216d8c779bae4f23abad82ca3479223e1f20c5ebc42"}
Jul 20 18:20:43.404368 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:43.404318    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58" podStartSLOduration=1.404299318 podStartE2EDuration="1.404299318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:20:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:20:43.40350452 +0000 UTC m=+1950.775097779" watchObservedRunningTime="2026-07-20 18:20:43.404299318 +0000 UTC m=+1950.775892578"
Jul 20 18:20:44.384528 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:44.384487    2562 generic.go:356] "Generic (PLEG): container finished" podID="8daaf8d3-b4e5-4021-af68-19d76a5b1b23" containerID="ba36f917dcd55a84ebb832f4f1008b52f1825e41e0d92ead78f3455556f0ae69" exitCode=0
Jul 20 18:20:44.384916 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:44.384568    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58" event={"ID":"8daaf8d3-b4e5-4021-af68-19d76a5b1b23","Type":"ContainerDied","Data":"ba36f917dcd55a84ebb832f4f1008b52f1825e41e0d92ead78f3455556f0ae69"}
Jul 20 18:20:45.517905 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:45.517882    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"
Jul 20 18:20:45.569596 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:45.569567    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8daaf8d3-b4e5-4021-af68-19d76a5b1b23-maas-api-service-ca\") pod \"8daaf8d3-b4e5-4021-af68-19d76a5b1b23\" (UID: \"8daaf8d3-b4e5-4021-af68-19d76a5b1b23\") "
Jul 20 18:20:45.569923 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:45.569902    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8daaf8d3-b4e5-4021-af68-19d76a5b1b23-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8daaf8d3-b4e5-4021-af68-19d76a5b1b23" (UID: "8daaf8d3-b4e5-4021-af68-19d76a5b1b23"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:20:45.671003 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:45.670925    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8daaf8d3-b4e5-4021-af68-19d76a5b1b23-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:20:46.395703 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:46.395678    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"
Jul 20 18:20:46.395872 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:46.395717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58" event={"ID":"8daaf8d3-b4e5-4021-af68-19d76a5b1b23","Type":"ContainerDied","Data":"812abfadd05f66d8afc77216d8c779bae4f23abad82ca3479223e1f20c5ebc42"}
Jul 20 18:20:46.395872 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:46.395770    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="812abfadd05f66d8afc77216d8c779bae4f23abad82ca3479223e1f20c5ebc42"
Jul 20 18:20:52.928308 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:52.928266    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"]
Jul 20 18:20:52.928960 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:52.928546    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g" podUID="00e093e3-d754-41c1-b069-b9253fef5728" containerName="maas-api" containerID="cri-o://3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1" gracePeriod=30
Jul 20 18:20:52.962597 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:52.962563    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:53.184153 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.184091    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:53.246144 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.246101    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e093e3-d754-41c1-b069-b9253fef5728-maas-api-tls\") pod \"00e093e3-d754-41c1-b069-b9253fef5728\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") "
Jul 20 18:20:53.246144 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.246148    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s94m\" (UniqueName: \"kubernetes.io/projected/00e093e3-d754-41c1-b069-b9253fef5728-kube-api-access-9s94m\") pod \"00e093e3-d754-41c1-b069-b9253fef5728\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") "
Jul 20 18:20:53.246423 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.246219    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e093e3-d754-41c1-b069-b9253fef5728-openshift-service-ca\") pod \"00e093e3-d754-41c1-b069-b9253fef5728\" (UID: \"00e093e3-d754-41c1-b069-b9253fef5728\") "
Jul 20 18:20:53.246619 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.246593    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e093e3-d754-41c1-b069-b9253fef5728-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "00e093e3-d754-41c1-b069-b9253fef5728" (UID: "00e093e3-d754-41c1-b069-b9253fef5728"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:20:53.248555 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.248530    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e093e3-d754-41c1-b069-b9253fef5728-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "00e093e3-d754-41c1-b069-b9253fef5728" (UID: "00e093e3-d754-41c1-b069-b9253fef5728"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:20:53.248663 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.248590    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e093e3-d754-41c1-b069-b9253fef5728-kube-api-access-9s94m" (OuterVolumeSpecName: "kube-api-access-9s94m") pod "00e093e3-d754-41c1-b069-b9253fef5728" (UID: "00e093e3-d754-41c1-b069-b9253fef5728"). InnerVolumeSpecName "kube-api-access-9s94m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:20:53.347858 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.347826    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e093e3-d754-41c1-b069-b9253fef5728-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:20:53.347858 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.347854    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e093e3-d754-41c1-b069-b9253fef5728-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:20:53.347858 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.347863    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s94m\" (UniqueName: \"kubernetes.io/projected/00e093e3-d754-41c1-b069-b9253fef5728-kube-api-access-9s94m\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:20:53.431637 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.431604    2562 generic.go:356] "Generic (PLEG): container finished" podID="00e093e3-d754-41c1-b069-b9253fef5728" containerID="3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1" exitCode=0
Jul 20 18:20:53.431812 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.431654    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"
Jul 20 18:20:53.431812 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.431696    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g" event={"ID":"00e093e3-d754-41c1-b069-b9253fef5728","Type":"ContainerDied","Data":"3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1"}
Jul 20 18:20:53.431812 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.431748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g" event={"ID":"00e093e3-d754-41c1-b069-b9253fef5728","Type":"ContainerDied","Data":"96842279a654988ba2dbe07e7cf8bbce95e71361356e89e186ec48c1bd885e11"}
Jul 20 18:20:53.431812 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.431773    2562 scope.go:117] "RemoveContainer" containerID="3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1"
Jul 20 18:20:53.448092 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.448072    2562 scope.go:117] "RemoveContainer" containerID="3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1"
Jul 20 18:20:53.448439 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:20:53.448413    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1\": container with ID starting with 3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1 not found: ID does not exist" containerID="3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1"
Jul 20 18:20:53.448503 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.448448    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1"} err="failed to get container status \"3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1\": rpc error: code = NotFound desc = could not find container \"3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1\": container with ID starting with 3a6362156386da235809b70e8280fcddf33757beda5e815f56c7b689408690c1 not found: ID does not exist"
Jul 20 18:20:53.468631 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.468603    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"]
Jul 20 18:20:53.486881 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:53.486848    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-337dced0-f757ff5b7-9tp5g"]
Jul 20 18:20:55.180573 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:55.180537    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00e093e3-d754-41c1-b069-b9253fef5728" path="/var/lib/kubelet/pods/00e093e3-d754-41c1-b069-b9253fef5728/volumes"
Jul 20 18:20:57.320523 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:57.320471    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"]
Jul 20 18:20:57.322405 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:57.322364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:57.322744 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:57.322723    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-337dced0-k8l58"]
Jul 20 18:20:57.571362 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:57.571282    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:57.778950 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:57.778916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:58.034245 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:58.034211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:58.129733 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:58.129702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:58.255532 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:58.255501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:58.630274 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:58.630238    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:58.847223 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:58.847186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:20:59.180858 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:20:59.180825    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8daaf8d3-b4e5-4021-af68-19d76a5b1b23" path="/var/lib/kubelet/pods/8daaf8d3-b4e5-4021-af68-19d76a5b1b23/volumes"
Jul 20 18:21:03.497945 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.497917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:03.583009 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.582976    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"]
Jul 20 18:21:03.583417 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.583385    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e093e3-d754-41c1-b069-b9253fef5728" containerName="maas-api"
Jul 20 18:21:03.583495 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.583419    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e093e3-d754-41c1-b069-b9253fef5728" containerName="maas-api"
Jul 20 18:21:03.583495 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.583439    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8daaf8d3-b4e5-4021-af68-19d76a5b1b23" containerName="revoke-keys"
Jul 20 18:21:03.583495 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.583444    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8daaf8d3-b4e5-4021-af68-19d76a5b1b23" containerName="revoke-keys"
Jul 20 18:21:03.583648 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.583515    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e093e3-d754-41c1-b069-b9253fef5728" containerName="maas-api"
Jul 20 18:21:03.583648 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.583523    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8daaf8d3-b4e5-4021-af68-19d76a5b1b23" containerName="revoke-keys"
Jul 20 18:21:03.588184 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.588166    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:03.590722 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.590700    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-34379a7f-serving-cert\""
Jul 20 18:21:03.597558 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.596892    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"]
Jul 20 18:21:03.612489 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.612453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:03.654949 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.654905    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvqwp\" (UniqueName: \"kubernetes.io/projected/9fad18fe-be6d-4084-a71c-141cbdd8c307-kube-api-access-pvqwp\") pod \"maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:03.655128 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.654976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fad18fe-be6d-4084-a71c-141cbdd8c307-openshift-service-ca\") pod \"maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:03.655128 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.655012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fad18fe-be6d-4084-a71c-141cbdd8c307-maas-api-tls\") pod \"maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:03.732022 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.731946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:03.756517 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.756442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvqwp\" (UniqueName: \"kubernetes.io/projected/9fad18fe-be6d-4084-a71c-141cbdd8c307-kube-api-access-pvqwp\") pod \"maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:03.756517 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.756478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fad18fe-be6d-4084-a71c-141cbdd8c307-openshift-service-ca\") pod \"maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:03.756517 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.756504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fad18fe-be6d-4084-a71c-141cbdd8c307-maas-api-tls\") pod \"maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:03.757182 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.757161    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fad18fe-be6d-4084-a71c-141cbdd8c307-openshift-service-ca\") pod \"maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:03.759133 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.759112    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fad18fe-be6d-4084-a71c-141cbdd8c307-maas-api-tls\") pod \"maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:03.767722 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.767699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvqwp\" (UniqueName: \"kubernetes.io/projected/9fad18fe-be6d-4084-a71c-141cbdd8c307-kube-api-access-pvqwp\") pod \"maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:03.903214 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:03.903175    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:04.054324 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:21:04.054284    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fad18fe_be6d_4084_a71c_141cbdd8c307.slice/crio-e274bde2a404024bdefbda05e3ecdc0450455fe3e78de3c4583afc1ef2fd0790 WatchSource:0}: Error finding container e274bde2a404024bdefbda05e3ecdc0450455fe3e78de3c4583afc1ef2fd0790: Status 404 returned error can't find the container with id e274bde2a404024bdefbda05e3ecdc0450455fe3e78de3c4583afc1ef2fd0790
Jul 20 18:21:04.058914 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:04.058886    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"]
Jul 20 18:21:04.254690 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:04.254658    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:04.354533 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:04.354505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:04.495093 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:04.495069    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr" event={"ID":"9fad18fe-be6d-4084-a71c-141cbdd8c307","Type":"ContainerStarted","Data":"e274bde2a404024bdefbda05e3ecdc0450455fe3e78de3c4583afc1ef2fd0790"}
Jul 20 18:21:05.501196 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:05.501157    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr" event={"ID":"9fad18fe-be6d-4084-a71c-141cbdd8c307","Type":"ContainerStarted","Data":"f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8"}
Jul 20 18:21:05.501658 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:05.501227    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:05.523586 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:05.523542    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr" podStartSLOduration=2.139101437 podStartE2EDuration="2.523526645s" totalImagesPullingTime="384.425208ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:21:05.522202875 +0000 UTC m=+1972.893796135" watchObservedRunningTime="2026-07-20 18:21:05.523526645 +0000 UTC m=+1972.895119904"
Jul 20 18:21:11.513172 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:11.513144    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:28.590664 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:28.590629    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"]
Jul 20 18:21:28.594107 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:28.594089    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"
Jul 20 18:21:28.596736 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:28.596714    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:21:28.601979 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:28.601541    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"]
Jul 20 18:21:28.692789 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:28.692755    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b15855dc-e3d6-4bb5-895e-8ab2c79afbae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz\" (UID: \"b15855dc-e3d6-4bb5-895e-8ab2c79afbae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"
Jul 20 18:21:28.794325 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:28.794293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b15855dc-e3d6-4bb5-895e-8ab2c79afbae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz\" (UID: \"b15855dc-e3d6-4bb5-895e-8ab2c79afbae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"
Jul 20 18:21:28.794927 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:28.794907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b15855dc-e3d6-4bb5-895e-8ab2c79afbae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz\" (UID: \"b15855dc-e3d6-4bb5-895e-8ab2c79afbae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"
Jul 20 18:21:28.906758 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:28.906685    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"
Jul 20 18:21:29.045345 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:29.045316    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"]
Jul 20 18:21:29.047523 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:21:29.047497    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15855dc_e3d6_4bb5_895e_8ab2c79afbae.slice/crio-f18bf8a65e4c9def0cdbfd134e466b379289fa916826f80c19559d7d7a7796ba WatchSource:0}: Error finding container f18bf8a65e4c9def0cdbfd134e466b379289fa916826f80c19559d7d7a7796ba: Status 404 returned error can't find the container with id f18bf8a65e4c9def0cdbfd134e466b379289fa916826f80c19559d7d7a7796ba
Jul 20 18:21:29.625302 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:29.625272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz" event={"ID":"b15855dc-e3d6-4bb5-895e-8ab2c79afbae","Type":"ContainerStarted","Data":"95e2d043007871897de526c49ce2f9d0e86bb650ca6898d76b4c0c95c7a6969a"}
Jul 20 18:21:29.625708 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:29.625327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz" event={"ID":"b15855dc-e3d6-4bb5-895e-8ab2c79afbae","Type":"ContainerStarted","Data":"f18bf8a65e4c9def0cdbfd134e466b379289fa916826f80c19559d7d7a7796ba"}
Jul 20 18:21:29.642149 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:29.642100    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz" podStartSLOduration=1.642084957 podStartE2EDuration="1.642084957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:21:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:21:29.640800194 +0000 UTC m=+1997.012393453" watchObservedRunningTime="2026-07-20 18:21:29.642084957 +0000 UTC m=+1997.013678215"
Jul 20 18:21:30.631461 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:30.631428    2562 generic.go:356] "Generic (PLEG): container finished" podID="b15855dc-e3d6-4bb5-895e-8ab2c79afbae" containerID="95e2d043007871897de526c49ce2f9d0e86bb650ca6898d76b4c0c95c7a6969a" exitCode=0
Jul 20 18:21:30.631851 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:30.631564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz" event={"ID":"b15855dc-e3d6-4bb5-895e-8ab2c79afbae","Type":"ContainerDied","Data":"95e2d043007871897de526c49ce2f9d0e86bb650ca6898d76b4c0c95c7a6969a"}
Jul 20 18:21:31.770324 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:31.770301    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"
Jul 20 18:21:31.824958 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:31.824927    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b15855dc-e3d6-4bb5-895e-8ab2c79afbae-maas-api-service-ca\") pod \"b15855dc-e3d6-4bb5-895e-8ab2c79afbae\" (UID: \"b15855dc-e3d6-4bb5-895e-8ab2c79afbae\") "
Jul 20 18:21:31.825262 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:31.825242    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b15855dc-e3d6-4bb5-895e-8ab2c79afbae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b15855dc-e3d6-4bb5-895e-8ab2c79afbae" (UID: "b15855dc-e3d6-4bb5-895e-8ab2c79afbae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:21:31.926287 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:31.926213    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b15855dc-e3d6-4bb5-895e-8ab2c79afbae-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:21:32.643336 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:32.643307    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"
Jul 20 18:21:32.643549 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:32.643308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz" event={"ID":"b15855dc-e3d6-4bb5-895e-8ab2c79afbae","Type":"ContainerDied","Data":"f18bf8a65e4c9def0cdbfd134e466b379289fa916826f80c19559d7d7a7796ba"}
Jul 20 18:21:32.643549 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:32.643458    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f18bf8a65e4c9def0cdbfd134e466b379289fa916826f80c19559d7d7a7796ba"
Jul 20 18:21:39.149583 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.149549    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"]
Jul 20 18:21:39.150080 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.149781    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr" podUID="9fad18fe-be6d-4084-a71c-141cbdd8c307" containerName="maas-api" containerID="cri-o://f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8" gracePeriod=30
Jul 20 18:21:39.405067 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.404996    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:39.504054 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.504023    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvqwp\" (UniqueName: \"kubernetes.io/projected/9fad18fe-be6d-4084-a71c-141cbdd8c307-kube-api-access-pvqwp\") pod \"9fad18fe-be6d-4084-a71c-141cbdd8c307\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") "
Jul 20 18:21:39.504054 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.504054    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fad18fe-be6d-4084-a71c-141cbdd8c307-openshift-service-ca\") pod \"9fad18fe-be6d-4084-a71c-141cbdd8c307\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") "
Jul 20 18:21:39.504250 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.504088    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fad18fe-be6d-4084-a71c-141cbdd8c307-maas-api-tls\") pod \"9fad18fe-be6d-4084-a71c-141cbdd8c307\" (UID: \"9fad18fe-be6d-4084-a71c-141cbdd8c307\") "
Jul 20 18:21:39.504478 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.504454    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fad18fe-be6d-4084-a71c-141cbdd8c307-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9fad18fe-be6d-4084-a71c-141cbdd8c307" (UID: "9fad18fe-be6d-4084-a71c-141cbdd8c307"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:21:39.506329 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.506303    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fad18fe-be6d-4084-a71c-141cbdd8c307-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9fad18fe-be6d-4084-a71c-141cbdd8c307" (UID: "9fad18fe-be6d-4084-a71c-141cbdd8c307"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:21:39.506521 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.506500    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fad18fe-be6d-4084-a71c-141cbdd8c307-kube-api-access-pvqwp" (OuterVolumeSpecName: "kube-api-access-pvqwp") pod "9fad18fe-be6d-4084-a71c-141cbdd8c307" (UID: "9fad18fe-be6d-4084-a71c-141cbdd8c307"). InnerVolumeSpecName "kube-api-access-pvqwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:21:39.605773 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.605734    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvqwp\" (UniqueName: \"kubernetes.io/projected/9fad18fe-be6d-4084-a71c-141cbdd8c307-kube-api-access-pvqwp\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:21:39.605773 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.605761    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fad18fe-be6d-4084-a71c-141cbdd8c307-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:21:39.605773 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.605773    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fad18fe-be6d-4084-a71c-141cbdd8c307-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:21:39.684032 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.683928    2562 generic.go:356] "Generic (PLEG): container finished" podID="9fad18fe-be6d-4084-a71c-141cbdd8c307" containerID="f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8" exitCode=0
Jul 20 18:21:39.684032 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.683980    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"
Jul 20 18:21:39.684032 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.683987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr" event={"ID":"9fad18fe-be6d-4084-a71c-141cbdd8c307","Type":"ContainerDied","Data":"f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8"}
Jul 20 18:21:39.684301 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.684036    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr" event={"ID":"9fad18fe-be6d-4084-a71c-141cbdd8c307","Type":"ContainerDied","Data":"e274bde2a404024bdefbda05e3ecdc0450455fe3e78de3c4583afc1ef2fd0790"}
Jul 20 18:21:39.684301 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.684062    2562 scope.go:117] "RemoveContainer" containerID="f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8"
Jul 20 18:21:39.694790 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.694773    2562 scope.go:117] "RemoveContainer" containerID="f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8"
Jul 20 18:21:39.695069 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:21:39.695048    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8\": container with ID starting with f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8 not found: ID does not exist" containerID="f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8"
Jul 20 18:21:39.695133 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.695080    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8"} err="failed to get container status \"f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8\": rpc error: code = NotFound desc = could not find container \"f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8\": container with ID starting with f882c797d295aa9dd521e841f242984ec16ec34e0083b8f47628477e1146a5c8 not found: ID does not exist"
Jul 20 18:21:39.706360 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.706334    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"]
Jul 20 18:21:39.710788 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:39.710768    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-34379a7f-5d4f9b4967-hgqrr"]
Jul 20 18:21:40.338675 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:40.338642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:41.181182 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:41.181151    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fad18fe-be6d-4084-a71c-141cbdd8c307" path="/var/lib/kubelet/pods/9fad18fe-be6d-4084-a71c-141cbdd8c307/volumes"
Jul 20 18:21:43.678516 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:43.678476    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"]
Jul 20 18:21:43.680363 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:43.680336    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-34379a7f-dpvrz"]
Jul 20 18:21:43.680363 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:43.680349    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:43.844235 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:43.844200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:44.079051 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:44.078972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:45.180874 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:45.180842    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b15855dc-e3d6-4bb5-895e-8ab2c79afbae" path="/var/lib/kubelet/pods/b15855dc-e3d6-4bb5-895e-8ab2c79afbae/volumes"
Jul 20 18:21:45.366169 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:45.366137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:45.470716 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:45.470614    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:46.686744 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.686697    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:46.789679 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.789630    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:46.790503 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.790480    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"]
Jul 20 18:21:46.790909 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.790896    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b15855dc-e3d6-4bb5-895e-8ab2c79afbae" containerName="revoke-keys"
Jul 20 18:21:46.790909 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.790910    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b15855dc-e3d6-4bb5-895e-8ab2c79afbae" containerName="revoke-keys"
Jul 20 18:21:46.791026 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.790937    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fad18fe-be6d-4084-a71c-141cbdd8c307" containerName="maas-api"
Jul 20 18:21:46.791026 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.790942    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fad18fe-be6d-4084-a71c-141cbdd8c307" containerName="maas-api"
Jul 20 18:21:46.791026 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.791000    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fad18fe-be6d-4084-a71c-141cbdd8c307" containerName="maas-api"
Jul 20 18:21:46.791026 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.791009    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b15855dc-e3d6-4bb5-895e-8ab2c79afbae" containerName="revoke-keys"
Jul 20 18:21:46.794218 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.794199    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:46.798214 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.798187    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-bd66d6f4-serving-cert\""
Jul 20 18:21:46.811589 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.811565    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"]
Jul 20 18:21:46.876049 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.876011    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/696b96ce-74e5-42a6-ad36-bda618058905-openshift-service-ca\") pod \"maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:46.876219 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.876061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdb6j\" (UniqueName: \"kubernetes.io/projected/696b96ce-74e5-42a6-ad36-bda618058905-kube-api-access-rdb6j\") pod \"maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:46.876219 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.876183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/696b96ce-74e5-42a6-ad36-bda618058905-maas-api-tls\") pod \"maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:46.887399 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.887366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:46.977288 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.977199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/696b96ce-74e5-42a6-ad36-bda618058905-maas-api-tls\") pod \"maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:46.977288 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.977274    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/696b96ce-74e5-42a6-ad36-bda618058905-openshift-service-ca\") pod \"maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:46.977539 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.977297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdb6j\" (UniqueName: \"kubernetes.io/projected/696b96ce-74e5-42a6-ad36-bda618058905-kube-api-access-rdb6j\") pod \"maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:46.977539 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:21:46.977316    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-serving-cert: secret "maas-api-e2e-ait-bd66d6f4-serving-cert" not found
Jul 20 18:21:46.977539 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:21:46.977418    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/696b96ce-74e5-42a6-ad36-bda618058905-maas-api-tls podName:696b96ce-74e5-42a6-ad36-bda618058905 nodeName:}" failed. No retries permitted until 2026-07-20 18:21:47.477372705 +0000 UTC m=+2014.848965941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/696b96ce-74e5-42a6-ad36-bda618058905-maas-api-tls") pod "maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv" (UID: "696b96ce-74e5-42a6-ad36-bda618058905") : secret "maas-api-e2e-ait-bd66d6f4-serving-cert" not found
Jul 20 18:21:46.978054 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.978033    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/696b96ce-74e5-42a6-ad36-bda618058905-openshift-service-ca\") pod \"maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:46.992203 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:46.992172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdb6j\" (UniqueName: \"kubernetes.io/projected/696b96ce-74e5-42a6-ad36-bda618058905-kube-api-access-rdb6j\") pod \"maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:47.216696 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:47.216662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:47.483511 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:47.483480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/696b96ce-74e5-42a6-ad36-bda618058905-maas-api-tls\") pod \"maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:47.486014 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:47.485995    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/696b96ce-74e5-42a6-ad36-bda618058905-maas-api-tls\") pod \"maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:47.704550 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:47.704521    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:47.734622 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:47.734514    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:47.832796 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:47.832764    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:21:47.855930 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:47.855904    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"]
Jul 20 18:21:47.857900 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:21:47.857864    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696b96ce_74e5_42a6_ad36_bda618058905.slice/crio-bfec06fdb43aabc6b429926de6773dc226036a0576d85f1c6ecf692ba2c3a621 WatchSource:0}: Error finding container bfec06fdb43aabc6b429926de6773dc226036a0576d85f1c6ecf692ba2c3a621: Status 404 returned error can't find the container with id bfec06fdb43aabc6b429926de6773dc226036a0576d85f1c6ecf692ba2c3a621
Jul 20 18:21:48.736342 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:48.736306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv" event={"ID":"696b96ce-74e5-42a6-ad36-bda618058905","Type":"ContainerStarted","Data":"6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7"}
Jul 20 18:21:48.736831 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:48.736361    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv" event={"ID":"696b96ce-74e5-42a6-ad36-bda618058905","Type":"ContainerStarted","Data":"bfec06fdb43aabc6b429926de6773dc226036a0576d85f1c6ecf692ba2c3a621"}
Jul 20 18:21:48.736831 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:48.736423    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:21:48.758894 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:48.758839    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv" podStartSLOduration=2.369907601 podStartE2EDuration="2.758819112s" totalImagesPullingTime="388.911511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:21:48.758579313 +0000 UTC m=+2016.130172563" watchObservedRunningTime="2026-07-20 18:21:48.758819112 +0000 UTC m=+2016.130412373"
Jul 20 18:21:54.746853 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:21:54.746815    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:22:11.039702 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:11.039668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:11.101243 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:11.101211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:12.477999 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:12.477970    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"]
Jul 20 18:22:12.481609 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:12.481590    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"
Jul 20 18:22:12.484050 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:12.484030    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:22:12.488938 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:12.488914    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"]
Jul 20 18:22:12.531758 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:12.531733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d92e89a8-2655-4e02-be5d-0cd6535a8269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj\" (UID: \"d92e89a8-2655-4e02-be5d-0cd6535a8269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"
Jul 20 18:22:12.632966 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:12.632931    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d92e89a8-2655-4e02-be5d-0cd6535a8269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj\" (UID: \"d92e89a8-2655-4e02-be5d-0cd6535a8269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"
Jul 20 18:22:12.633577 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:12.633560    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d92e89a8-2655-4e02-be5d-0cd6535a8269-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj\" (UID: \"d92e89a8-2655-4e02-be5d-0cd6535a8269\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"
Jul 20 18:22:12.794596 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:12.794520    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"
Jul 20 18:22:12.929332 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:12.929301    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"]
Jul 20 18:22:12.930551 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:22:12.930525    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92e89a8_2655_4e02_be5d_0cd6535a8269.slice/crio-eba0d444e7942d4d769ccc8109cd3deabf069986898f9bf4b72fbe45474d5780 WatchSource:0}: Error finding container eba0d444e7942d4d769ccc8109cd3deabf069986898f9bf4b72fbe45474d5780: Status 404 returned error can't find the container with id eba0d444e7942d4d769ccc8109cd3deabf069986898f9bf4b72fbe45474d5780
Jul 20 18:22:13.869444 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:13.869416    2562 generic.go:356] "Generic (PLEG): container finished" podID="d92e89a8-2655-4e02-be5d-0cd6535a8269" containerID="699ae7c9e4c653ecc4c0822a8aaa0be7b7b26781d41c2b989732841f285a973f" exitCode=0
Jul 20 18:22:13.869830 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:13.869498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj" event={"ID":"d92e89a8-2655-4e02-be5d-0cd6535a8269","Type":"ContainerDied","Data":"699ae7c9e4c653ecc4c0822a8aaa0be7b7b26781d41c2b989732841f285a973f"}
Jul 20 18:22:13.869830 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:13.869541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj" event={"ID":"d92e89a8-2655-4e02-be5d-0cd6535a8269","Type":"ContainerStarted","Data":"eba0d444e7942d4d769ccc8109cd3deabf069986898f9bf4b72fbe45474d5780"}
Jul 20 18:22:15.006913 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:15.006886    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"
Jul 20 18:22:15.158521 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:15.158441    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d92e89a8-2655-4e02-be5d-0cd6535a8269-maas-api-service-ca\") pod \"d92e89a8-2655-4e02-be5d-0cd6535a8269\" (UID: \"d92e89a8-2655-4e02-be5d-0cd6535a8269\") "
Jul 20 18:22:15.158786 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:15.158763    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d92e89a8-2655-4e02-be5d-0cd6535a8269-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d92e89a8-2655-4e02-be5d-0cd6535a8269" (UID: "d92e89a8-2655-4e02-be5d-0cd6535a8269"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:22:15.259715 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:15.259685    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d92e89a8-2655-4e02-be5d-0cd6535a8269-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:22:15.880903 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:15.880868    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj" event={"ID":"d92e89a8-2655-4e02-be5d-0cd6535a8269","Type":"ContainerDied","Data":"eba0d444e7942d4d769ccc8109cd3deabf069986898f9bf4b72fbe45474d5780"}
Jul 20 18:22:15.881054 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:15.880918    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eba0d444e7942d4d769ccc8109cd3deabf069986898f9bf4b72fbe45474d5780"
Jul 20 18:22:15.881054 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:15.880886    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"
Jul 20 18:22:22.945307 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:22.945276    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"]
Jul 20 18:22:22.945799 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:22.945507    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv" podUID="696b96ce-74e5-42a6-ad36-bda618058905" containerName="maas-api" containerID="cri-o://6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7" gracePeriod=30
Jul 20 18:22:22.984254 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:22.984227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:23.198123 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.198061    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:22:23.333775 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.333738    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/696b96ce-74e5-42a6-ad36-bda618058905-maas-api-tls\") pod \"696b96ce-74e5-42a6-ad36-bda618058905\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") "
Jul 20 18:22:23.333953 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.333836    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdb6j\" (UniqueName: \"kubernetes.io/projected/696b96ce-74e5-42a6-ad36-bda618058905-kube-api-access-rdb6j\") pod \"696b96ce-74e5-42a6-ad36-bda618058905\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") "
Jul 20 18:22:23.333953 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.333879    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/696b96ce-74e5-42a6-ad36-bda618058905-openshift-service-ca\") pod \"696b96ce-74e5-42a6-ad36-bda618058905\" (UID: \"696b96ce-74e5-42a6-ad36-bda618058905\") "
Jul 20 18:22:23.334284 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.334255    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/696b96ce-74e5-42a6-ad36-bda618058905-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "696b96ce-74e5-42a6-ad36-bda618058905" (UID: "696b96ce-74e5-42a6-ad36-bda618058905"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:22:23.335975 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.335947    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/696b96ce-74e5-42a6-ad36-bda618058905-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "696b96ce-74e5-42a6-ad36-bda618058905" (UID: "696b96ce-74e5-42a6-ad36-bda618058905"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:22:23.336176 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.336156    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/696b96ce-74e5-42a6-ad36-bda618058905-kube-api-access-rdb6j" (OuterVolumeSpecName: "kube-api-access-rdb6j") pod "696b96ce-74e5-42a6-ad36-bda618058905" (UID: "696b96ce-74e5-42a6-ad36-bda618058905"). InnerVolumeSpecName "kube-api-access-rdb6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:22:23.434876 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.434843    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/696b96ce-74e5-42a6-ad36-bda618058905-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:22:23.434876 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.434872    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdb6j\" (UniqueName: \"kubernetes.io/projected/696b96ce-74e5-42a6-ad36-bda618058905-kube-api-access-rdb6j\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:22:23.434876 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.434882    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/696b96ce-74e5-42a6-ad36-bda618058905-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:22:23.922897 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.922855    2562 generic.go:356] "Generic (PLEG): container finished" podID="696b96ce-74e5-42a6-ad36-bda618058905" containerID="6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7" exitCode=0
Jul 20 18:22:23.923099 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.922917    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"
Jul 20 18:22:23.923099 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.922940    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv" event={"ID":"696b96ce-74e5-42a6-ad36-bda618058905","Type":"ContainerDied","Data":"6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7"}
Jul 20 18:22:23.923099 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.923013    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv" event={"ID":"696b96ce-74e5-42a6-ad36-bda618058905","Type":"ContainerDied","Data":"bfec06fdb43aabc6b429926de6773dc226036a0576d85f1c6ecf692ba2c3a621"}
Jul 20 18:22:23.923099 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.923043    2562 scope.go:117] "RemoveContainer" containerID="6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7"
Jul 20 18:22:23.933145 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.933127    2562 scope.go:117] "RemoveContainer" containerID="6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7"
Jul 20 18:22:23.933485 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:22:23.933454    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7\": container with ID starting with 6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7 not found: ID does not exist" containerID="6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7"
Jul 20 18:22:23.933562 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.933486    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7"} err="failed to get container status \"6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7\": rpc error: code = NotFound desc = could not find container \"6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7\": container with ID starting with 6a081fa38378587fa4e0415a9c5129e48563f1642cdbba355eef61f9191538d7 not found: ID does not exist"
Jul 20 18:22:23.944516 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.944493    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"]
Jul 20 18:22:23.950648 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:23.950629    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bd66d6f4-5647d867b-cknfv"]
Jul 20 18:22:25.182642 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:25.182609    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="696b96ce-74e5-42a6-ad36-bda618058905" path="/var/lib/kubelet/pods/696b96ce-74e5-42a6-ad36-bda618058905/volumes"
Jul 20 18:22:27.548835 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:27.548801    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"]
Jul 20 18:22:27.551794 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:27.551735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:27.551794 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:27.551802    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd66d6f4-fkkzj"]
Jul 20 18:22:28.773182 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:28.773132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:29.000844 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:29.000813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:29.180810 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:29.180782    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d92e89a8-2655-4e02-be5d-0cd6535a8269" path="/var/lib/kubelet/pods/d92e89a8-2655-4e02-be5d-0cd6535a8269/volumes"
Jul 20 18:22:29.224132 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:29.224097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:29.538035 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:29.537958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:29.761585 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:29.761554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:31.846324 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.846288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:31.930557 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.930527    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"]
Jul 20 18:22:31.930982 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.930964    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d92e89a8-2655-4e02-be5d-0cd6535a8269" containerName="revoke-keys"
Jul 20 18:22:31.931075 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.930984    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d92e89a8-2655-4e02-be5d-0cd6535a8269" containerName="revoke-keys"
Jul 20 18:22:31.931075 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.931008    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="696b96ce-74e5-42a6-ad36-bda618058905" containerName="maas-api"
Jul 20 18:22:31.931075 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.931016    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="696b96ce-74e5-42a6-ad36-bda618058905" containerName="maas-api"
Jul 20 18:22:31.931231 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.931118    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d92e89a8-2655-4e02-be5d-0cd6535a8269" containerName="revoke-keys"
Jul 20 18:22:31.931231 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.931135    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="696b96ce-74e5-42a6-ad36-bda618058905" containerName="maas-api"
Jul 20 18:22:31.935328 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.935302    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:31.935594 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.935580    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:31.938429 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.938380    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-e0a9248b-serving-cert\""
Jul 20 18:22:31.946199 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:31.946173    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"]
Jul 20 18:22:32.010939 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.010910    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:32.117551 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.117469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q67vj\" (UniqueName: \"kubernetes.io/projected/6983bf04-3839-405a-908e-079e0c7bc054-kube-api-access-q67vj\") pod \"maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:32.117705 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.117574    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6983bf04-3839-405a-908e-079e0c7bc054-maas-api-tls\") pod \"maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:32.117705 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.117645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6983bf04-3839-405a-908e-079e0c7bc054-openshift-service-ca\") pod \"maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:32.122510 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.122462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:32.218578 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.218542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q67vj\" (UniqueName: \"kubernetes.io/projected/6983bf04-3839-405a-908e-079e0c7bc054-kube-api-access-q67vj\") pod \"maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:32.218788 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.218643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6983bf04-3839-405a-908e-079e0c7bc054-maas-api-tls\") pod \"maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:32.218788 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.218722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6983bf04-3839-405a-908e-079e0c7bc054-openshift-service-ca\") pod \"maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:32.219354 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.219329    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6983bf04-3839-405a-908e-079e0c7bc054-openshift-service-ca\") pod \"maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:32.221194 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.221177    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6983bf04-3839-405a-908e-079e0c7bc054-maas-api-tls\") pod \"maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:32.227540 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.227522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q67vj\" (UniqueName: \"kubernetes.io/projected/6983bf04-3839-405a-908e-079e0c7bc054-kube-api-access-q67vj\") pod \"maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:32.247536 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.247512    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:32.591001 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.590976    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"]
Jul 20 18:22:32.594081 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:22:32.594050    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6983bf04_3839_405a_908e_079e0c7bc054.slice/crio-faf4790cdd226e6382a7af66457acccb2d889e161700302c03383be1e6139135 WatchSource:0}: Error finding container faf4790cdd226e6382a7af66457acccb2d889e161700302c03383be1e6139135: Status 404 returned error can't find the container with id faf4790cdd226e6382a7af66457acccb2d889e161700302c03383be1e6139135
Jul 20 18:22:32.633586 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.633557    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:32.736658 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.736624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:32.973341 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:32.973245    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm" event={"ID":"6983bf04-3839-405a-908e-079e0c7bc054","Type":"ContainerStarted","Data":"faf4790cdd226e6382a7af66457acccb2d889e161700302c03383be1e6139135"}
Jul 20 18:22:33.979634 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:33.979554    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm" event={"ID":"6983bf04-3839-405a-908e-079e0c7bc054","Type":"ContainerStarted","Data":"963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3"}
Jul 20 18:22:33.979993 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:33.979634    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:34.003894 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:34.003762    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm" podStartSLOduration=2.585695937 podStartE2EDuration="3.003740513s" totalImagesPullingTime="418.044576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:22:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:22:34.003187368 +0000 UTC m=+2061.374780629" watchObservedRunningTime="2026-07-20 18:22:34.003740513 +0000 UTC m=+2061.375333775"
Jul 20 18:22:37.849465 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:37.849433    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:37.909234 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:37.909205    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:22:39.990271 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:39.990242    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:22:56.735584 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:56.735548    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"]
Jul 20 18:22:56.739060 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:56.739044    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"
Jul 20 18:22:56.741573 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:56.741556    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:22:56.748339 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:56.748318    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"]
Jul 20 18:22:56.865369 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:56.865331    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278f6298-f1c0-496b-9db5-9cab1f495176-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9\" (UID: \"278f6298-f1c0-496b-9db5-9cab1f495176\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"
Jul 20 18:22:56.966660 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:56.966622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278f6298-f1c0-496b-9db5-9cab1f495176-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9\" (UID: \"278f6298-f1c0-496b-9db5-9cab1f495176\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"
Jul 20 18:22:56.967181 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:56.967160    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278f6298-f1c0-496b-9db5-9cab1f495176-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9\" (UID: \"278f6298-f1c0-496b-9db5-9cab1f495176\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"
Jul 20 18:22:57.050078 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:57.049996    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"
Jul 20 18:22:57.194546 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:57.194517    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"]
Jul 20 18:22:57.197951 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:22:57.197924    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278f6298_f1c0_496b_9db5_9cab1f495176.slice/crio-18dd013231728445e13118130268d16ff4a5ae61d83814994264573b8700d589 WatchSource:0}: Error finding container 18dd013231728445e13118130268d16ff4a5ae61d83814994264573b8700d589: Status 404 returned error can't find the container with id 18dd013231728445e13118130268d16ff4a5ae61d83814994264573b8700d589
Jul 20 18:22:58.107047 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:58.107011    2562 generic.go:356] "Generic (PLEG): container finished" podID="278f6298-f1c0-496b-9db5-9cab1f495176" containerID="d41c60d3a7d09f37befad6fb19010df310b4b439f3f0551d3ed98f90b348fba6" exitCode=0
Jul 20 18:22:58.107474 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:58.107092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9" event={"ID":"278f6298-f1c0-496b-9db5-9cab1f495176","Type":"ContainerDied","Data":"d41c60d3a7d09f37befad6fb19010df310b4b439f3f0551d3ed98f90b348fba6"}
Jul 20 18:22:58.107474 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:58.107142    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9" event={"ID":"278f6298-f1c0-496b-9db5-9cab1f495176","Type":"ContainerStarted","Data":"18dd013231728445e13118130268d16ff4a5ae61d83814994264573b8700d589"}
Jul 20 18:22:59.244600 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:59.244575    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"
Jul 20 18:22:59.392808 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:59.392724    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278f6298-f1c0-496b-9db5-9cab1f495176-maas-api-service-ca\") pod \"278f6298-f1c0-496b-9db5-9cab1f495176\" (UID: \"278f6298-f1c0-496b-9db5-9cab1f495176\") "
Jul 20 18:22:59.393073 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:59.393051    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/278f6298-f1c0-496b-9db5-9cab1f495176-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "278f6298-f1c0-496b-9db5-9cab1f495176" (UID: "278f6298-f1c0-496b-9db5-9cab1f495176"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:22:59.493518 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:22:59.493488    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/278f6298-f1c0-496b-9db5-9cab1f495176-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:23:00.117637 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:00.117605    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9" event={"ID":"278f6298-f1c0-496b-9db5-9cab1f495176","Type":"ContainerDied","Data":"18dd013231728445e13118130268d16ff4a5ae61d83814994264573b8700d589"}
Jul 20 18:23:00.117637 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:00.117628    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"
Jul 20 18:23:00.117859 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:00.117684    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18dd013231728445e13118130268d16ff4a5ae61d83814994264573b8700d589"
Jul 20 18:23:01.358710 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:01.358681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:01.457614 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:01.457584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:07.267434 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.267376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:07.368071 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.368040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:07.503750 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.503712    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"]
Jul 20 18:23:07.504001 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.503970    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm" podUID="6983bf04-3839-405a-908e-079e0c7bc054" containerName="maas-api" containerID="cri-o://963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3" gracePeriod=30
Jul 20 18:23:07.532201 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.532172    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:07.752021 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.751998    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:23:07.874085 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.874053    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6983bf04-3839-405a-908e-079e0c7bc054-maas-api-tls\") pod \"6983bf04-3839-405a-908e-079e0c7bc054\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") "
Jul 20 18:23:07.874278 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.874104    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6983bf04-3839-405a-908e-079e0c7bc054-openshift-service-ca\") pod \"6983bf04-3839-405a-908e-079e0c7bc054\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") "
Jul 20 18:23:07.874278 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.874139    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q67vj\" (UniqueName: \"kubernetes.io/projected/6983bf04-3839-405a-908e-079e0c7bc054-kube-api-access-q67vj\") pod \"6983bf04-3839-405a-908e-079e0c7bc054\" (UID: \"6983bf04-3839-405a-908e-079e0c7bc054\") "
Jul 20 18:23:07.874509 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.874485    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6983bf04-3839-405a-908e-079e0c7bc054-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6983bf04-3839-405a-908e-079e0c7bc054" (UID: "6983bf04-3839-405a-908e-079e0c7bc054"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:23:07.876257 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.876235    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6983bf04-3839-405a-908e-079e0c7bc054-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6983bf04-3839-405a-908e-079e0c7bc054" (UID: "6983bf04-3839-405a-908e-079e0c7bc054"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:23:07.876312 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.876276    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6983bf04-3839-405a-908e-079e0c7bc054-kube-api-access-q67vj" (OuterVolumeSpecName: "kube-api-access-q67vj") pod "6983bf04-3839-405a-908e-079e0c7bc054" (UID: "6983bf04-3839-405a-908e-079e0c7bc054"). InnerVolumeSpecName "kube-api-access-q67vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:23:07.975963 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.975928    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6983bf04-3839-405a-908e-079e0c7bc054-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:23:07.975963 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.975957    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6983bf04-3839-405a-908e-079e0c7bc054-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:23:07.975963 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:07.975966    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q67vj\" (UniqueName: \"kubernetes.io/projected/6983bf04-3839-405a-908e-079e0c7bc054-kube-api-access-q67vj\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:23:08.159935 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:08.159847    2562 generic.go:356] "Generic (PLEG): container finished" podID="6983bf04-3839-405a-908e-079e0c7bc054" containerID="963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3" exitCode=0
Jul 20 18:23:08.159935 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:08.159891    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"
Jul 20 18:23:08.159935 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:08.159897    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm" event={"ID":"6983bf04-3839-405a-908e-079e0c7bc054","Type":"ContainerDied","Data":"963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3"}
Jul 20 18:23:08.160189 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:08.159941    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm" event={"ID":"6983bf04-3839-405a-908e-079e0c7bc054","Type":"ContainerDied","Data":"faf4790cdd226e6382a7af66457acccb2d889e161700302c03383be1e6139135"}
Jul 20 18:23:08.160189 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:08.159962    2562 scope.go:117] "RemoveContainer" containerID="963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3"
Jul 20 18:23:08.169948 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:08.169930    2562 scope.go:117] "RemoveContainer" containerID="963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3"
Jul 20 18:23:08.170214 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:23:08.170195    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3\": container with ID starting with 963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3 not found: ID does not exist" containerID="963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3"
Jul 20 18:23:08.170286 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:08.170222    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3"} err="failed to get container status \"963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3\": rpc error: code = NotFound desc = could not find container \"963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3\": container with ID starting with 963bc7c3dfbfa4b372cbc3e0aef59edfbdfd1fa0367aed7a63711cc981c6bea3 not found: ID does not exist"
Jul 20 18:23:08.182126 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:08.182096    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"]
Jul 20 18:23:08.186288 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:08.186266    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0a9248b-f9f76fb56-7wgdm"]
Jul 20 18:23:09.181141 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:09.181103    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6983bf04-3839-405a-908e-079e0c7bc054" path="/var/lib/kubelet/pods/6983bf04-3839-405a-908e-079e0c7bc054/volumes"
Jul 20 18:23:11.803570 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:11.803529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:11.806039 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:11.804126    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"]
Jul 20 18:23:11.806517 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:11.806498    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0a9248b-g5lx9"]
Jul 20 18:23:11.958885 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:11.958831    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:12.200307 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:12.200274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:12.692620 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:12.692579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:12.863237 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:12.863206    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:12.959733 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:12.959659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:13.180757 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:13.180727    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="278f6298-f1c0-496b-9db5-9cab1f495176" path="/var/lib/kubelet/pods/278f6298-f1c0-496b-9db5-9cab1f495176/volumes"
Jul 20 18:23:13.220992 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:13.220904    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:23:13.223622 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:13.223599    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:23:14.326638 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:14.326608    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:20.159639 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:20.159601    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:20.272750 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:20.272713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:20.363450 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:20.363418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:20.462884 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:20.462799    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:20.908861 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:20.908826    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:46.877040 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:46.876996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:52.923710 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:52.923677    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:53.044886 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:53.044854    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:23:53.137004 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:23:53.136972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:09.131733 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:09.131661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:15.185351 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:15.185319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:15.285299 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:15.285266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:25.788912 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:25.788877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:26.611130 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:26.611083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:33.544341 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:33.544308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:33.662332 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:33.662293    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:33.761725 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:33.761696    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:33.859504 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:33.859477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:34.635818 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:34.635780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:34.722968 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:34.722935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:34.845542 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:34.845513    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:36.482951 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:36.482919    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:43.031692 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:43.031654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:43.134972 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:43.134942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:43.768881 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:43.768852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:49.648075 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:49.648041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:51.035451 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:51.035413    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:52.007950 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:52.007919    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:52.108741 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:52.108707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:53.160499 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.160467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:53.247758 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.247723    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"]
Jul 20 18:24:53.248156 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.248142    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6983bf04-3839-405a-908e-079e0c7bc054" containerName="maas-api"
Jul 20 18:24:53.248218 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.248161    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6983bf04-3839-405a-908e-079e0c7bc054" containerName="maas-api"
Jul 20 18:24:53.248218 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.248172    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="278f6298-f1c0-496b-9db5-9cab1f495176" containerName="revoke-keys"
Jul 20 18:24:53.248218 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.248179    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="278f6298-f1c0-496b-9db5-9cab1f495176" containerName="revoke-keys"
Jul 20 18:24:53.248374 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.248294    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6983bf04-3839-405a-908e-079e0c7bc054" containerName="maas-api"
Jul 20 18:24:53.248374 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.248314    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="278f6298-f1c0-496b-9db5-9cab1f495176" containerName="revoke-keys"
Jul 20 18:24:53.248980 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.248960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:53.251714 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.251699    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:53.258717 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.258690    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-fca5d313-serving-cert\""
Jul 20 18:24:53.267994 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.267963    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"]
Jul 20 18:24:53.334748 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.334720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:53.398065 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.398028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b63804-dcff-4384-a940-f30a94f95705-maas-api-tls\") pod \"maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:53.398065 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.398069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b63804-dcff-4384-a940-f30a94f95705-openshift-service-ca\") pod \"maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:53.398255 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.398106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjr66\" (UniqueName: \"kubernetes.io/projected/88b63804-dcff-4384-a940-f30a94f95705-kube-api-access-qjr66\") pod \"maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:53.499482 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.499379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b63804-dcff-4384-a940-f30a94f95705-maas-api-tls\") pod \"maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:53.499482 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.499431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b63804-dcff-4384-a940-f30a94f95705-openshift-service-ca\") pod \"maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:53.499482 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.499462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjr66\" (UniqueName: \"kubernetes.io/projected/88b63804-dcff-4384-a940-f30a94f95705-kube-api-access-qjr66\") pod \"maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:53.500067 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.500045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b63804-dcff-4384-a940-f30a94f95705-openshift-service-ca\") pod \"maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:53.501992 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.501968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b63804-dcff-4384-a940-f30a94f95705-maas-api-tls\") pod \"maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:53.504661 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.504634    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:53.509088 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.509068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjr66\" (UniqueName: \"kubernetes.io/projected/88b63804-dcff-4384-a940-f30a94f95705-kube-api-access-qjr66\") pod \"maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:53.565030 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.564996    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:53.711041 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.711018    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"]
Jul 20 18:24:53.713011 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:24:53.712984    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b63804_dcff_4384_a940_f30a94f95705.slice/crio-82d22ffe2b4feddd0718af152a9bbed05eec88d344d094ae22802201001778c3 WatchSource:0}: Error finding container 82d22ffe2b4feddd0718af152a9bbed05eec88d344d094ae22802201001778c3: Status 404 returned error can't find the container with id 82d22ffe2b4feddd0718af152a9bbed05eec88d344d094ae22802201001778c3
Jul 20 18:24:53.736922 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.736891    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc" event={"ID":"88b63804-dcff-4384-a940-f30a94f95705","Type":"ContainerStarted","Data":"82d22ffe2b4feddd0718af152a9bbed05eec88d344d094ae22802201001778c3"}
Jul 20 18:24:53.815008 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:53.814921    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:54.006161 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:54.006132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:54.743106 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:54.743070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc" event={"ID":"88b63804-dcff-4384-a940-f30a94f95705","Type":"ContainerStarted","Data":"75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502"}
Jul 20 18:24:54.743544 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:54.743138    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:24:54.761859 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:54.761818    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc" podStartSLOduration=1.26983144 podStartE2EDuration="1.761802346s" totalImagesPullingTime="491.970906ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:24:54.760935945 +0000 UTC m=+2202.132529198" watchObservedRunningTime="2026-07-20 18:24:54.761802346 +0000 UTC m=+2202.133395606"
Jul 20 18:24:57.670886 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:57.670844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:58.353835 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:58.353796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:58.452751 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:58.452717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:24:58.803996 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:24:58.803905    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:00.752728 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:00.752701    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:25:04.645514 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:04.645478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:04.708583 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:04.708549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:05.036577 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.036482    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"]
Jul 20 18:25:05.040456 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.040434    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"
Jul 20 18:25:05.043156 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.043139    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:25:05.048979 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.048947    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"]
Jul 20 18:25:05.116068 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.116039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9169ccdb-e1b6-43d9-9460-d7b6433dc406-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk\" (UID: \"9169ccdb-e1b6-43d9-9460-d7b6433dc406\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"
Jul 20 18:25:05.216659 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.216623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9169ccdb-e1b6-43d9-9460-d7b6433dc406-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk\" (UID: \"9169ccdb-e1b6-43d9-9460-d7b6433dc406\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"
Jul 20 18:25:05.217247 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.217228    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9169ccdb-e1b6-43d9-9460-d7b6433dc406-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk\" (UID: \"9169ccdb-e1b6-43d9-9460-d7b6433dc406\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"
Jul 20 18:25:05.351923 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.351892    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"
Jul 20 18:25:05.486532 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.486504    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"]
Jul 20 18:25:05.488640 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:25:05.488599    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9169ccdb_e1b6_43d9_9460_d7b6433dc406.slice/crio-81775165d6c7a643d56314b96910b451c687b8fd73284546f244d8f300fb1d81 WatchSource:0}: Error finding container 81775165d6c7a643d56314b96910b451c687b8fd73284546f244d8f300fb1d81: Status 404 returned error can't find the container with id 81775165d6c7a643d56314b96910b451c687b8fd73284546f244d8f300fb1d81
Jul 20 18:25:05.806996 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.806970    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk" event={"ID":"9169ccdb-e1b6-43d9-9460-d7b6433dc406","Type":"ContainerStarted","Data":"74f784a48627858f6420f4483719559ff2f3c5c05a26443d3b101fba68a1555c"}
Jul 20 18:25:05.807333 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.807015    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk" event={"ID":"9169ccdb-e1b6-43d9-9460-d7b6433dc406","Type":"ContainerStarted","Data":"81775165d6c7a643d56314b96910b451c687b8fd73284546f244d8f300fb1d81"}
Jul 20 18:25:05.827248 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:05.827204    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk" podStartSLOduration=0.827189938 podStartE2EDuration="827.189938ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:25:05.8269318 +0000 UTC m=+2213.198525059" watchObservedRunningTime="2026-07-20 18:25:05.827189938 +0000 UTC m=+2213.198783197"
Jul 20 18:25:06.814349 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:06.814318    2562 generic.go:356] "Generic (PLEG): container finished" podID="9169ccdb-e1b6-43d9-9460-d7b6433dc406" containerID="74f784a48627858f6420f4483719559ff2f3c5c05a26443d3b101fba68a1555c" exitCode=0
Jul 20 18:25:06.814773 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:06.814426    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk" event={"ID":"9169ccdb-e1b6-43d9-9460-d7b6433dc406","Type":"ContainerDied","Data":"74f784a48627858f6420f4483719559ff2f3c5c05a26443d3b101fba68a1555c"}
Jul 20 18:25:07.539549 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:07.539513    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:07.955709 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:07.955682    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"
Jul 20 18:25:08.039346 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:08.039311    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9169ccdb-e1b6-43d9-9460-d7b6433dc406-maas-api-service-ca\") pod \"9169ccdb-e1b6-43d9-9460-d7b6433dc406\" (UID: \"9169ccdb-e1b6-43d9-9460-d7b6433dc406\") "
Jul 20 18:25:08.039729 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:08.039702    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9169ccdb-e1b6-43d9-9460-d7b6433dc406-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9169ccdb-e1b6-43d9-9460-d7b6433dc406" (UID: "9169ccdb-e1b6-43d9-9460-d7b6433dc406"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:25:08.140602 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:08.140570    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9169ccdb-e1b6-43d9-9460-d7b6433dc406-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:25:08.825358 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:08.825328    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"
Jul 20 18:25:08.825543 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:08.825370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk" event={"ID":"9169ccdb-e1b6-43d9-9460-d7b6433dc406","Type":"ContainerDied","Data":"81775165d6c7a643d56314b96910b451c687b8fd73284546f244d8f300fb1d81"}
Jul 20 18:25:08.825543 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:08.825462    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81775165d6c7a643d56314b96910b451c687b8fd73284546f244d8f300fb1d81"
Jul 20 18:25:15.486130 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.486095    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"]
Jul 20 18:25:15.486573 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.486347    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc" podUID="88b63804-dcff-4384-a940-f30a94f95705" containerName="maas-api" containerID="cri-o://75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502" gracePeriod=30
Jul 20 18:25:15.515815 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.515779    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:15.739762 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.739705    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:25:15.815214 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.815177    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b63804-dcff-4384-a940-f30a94f95705-maas-api-tls\") pod \"88b63804-dcff-4384-a940-f30a94f95705\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") "
Jul 20 18:25:15.815430 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.815312    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b63804-dcff-4384-a940-f30a94f95705-openshift-service-ca\") pod \"88b63804-dcff-4384-a940-f30a94f95705\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") "
Jul 20 18:25:15.815430 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.815342    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjr66\" (UniqueName: \"kubernetes.io/projected/88b63804-dcff-4384-a940-f30a94f95705-kube-api-access-qjr66\") pod \"88b63804-dcff-4384-a940-f30a94f95705\" (UID: \"88b63804-dcff-4384-a940-f30a94f95705\") "
Jul 20 18:25:15.815733 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.815710    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88b63804-dcff-4384-a940-f30a94f95705-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88b63804-dcff-4384-a940-f30a94f95705" (UID: "88b63804-dcff-4384-a940-f30a94f95705"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:25:15.817586 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.817560    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b63804-dcff-4384-a940-f30a94f95705-kube-api-access-qjr66" (OuterVolumeSpecName: "kube-api-access-qjr66") pod "88b63804-dcff-4384-a940-f30a94f95705" (UID: "88b63804-dcff-4384-a940-f30a94f95705"). InnerVolumeSpecName "kube-api-access-qjr66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:25:15.817698 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.817674    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88b63804-dcff-4384-a940-f30a94f95705-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88b63804-dcff-4384-a940-f30a94f95705" (UID: "88b63804-dcff-4384-a940-f30a94f95705"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:25:15.863974 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.863946    2562 generic.go:356] "Generic (PLEG): container finished" podID="88b63804-dcff-4384-a940-f30a94f95705" containerID="75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502" exitCode=0
Jul 20 18:25:15.864119 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.863989    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"
Jul 20 18:25:15.864119 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.864041    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc" event={"ID":"88b63804-dcff-4384-a940-f30a94f95705","Type":"ContainerDied","Data":"75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502"}
Jul 20 18:25:15.864119 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.864095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc" event={"ID":"88b63804-dcff-4384-a940-f30a94f95705","Type":"ContainerDied","Data":"82d22ffe2b4feddd0718af152a9bbed05eec88d344d094ae22802201001778c3"}
Jul 20 18:25:15.864119 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.864118    2562 scope.go:117] "RemoveContainer" containerID="75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502"
Jul 20 18:25:15.873698 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.873681    2562 scope.go:117] "RemoveContainer" containerID="75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502"
Jul 20 18:25:15.873971 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:25:15.873952    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502\": container with ID starting with 75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502 not found: ID does not exist" containerID="75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502"
Jul 20 18:25:15.874030 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.873979    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502"} err="failed to get container status \"75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502\": rpc error: code = NotFound desc = could not find container \"75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502\": container with ID starting with 75df76ed70696cfe77db26e171adcf1e53ad2bde1237bb66be9b593e2764b502 not found: ID does not exist"
Jul 20 18:25:15.888486 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.888459    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"]
Jul 20 18:25:15.891501 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.891478    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-fca5d313-5c4b9449c7-4gvgc"]
Jul 20 18:25:15.916844 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.916825    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b63804-dcff-4384-a940-f30a94f95705-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:25:15.916916 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.916846    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjr66\" (UniqueName: \"kubernetes.io/projected/88b63804-dcff-4384-a940-f30a94f95705-kube-api-access-qjr66\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:25:15.916916 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:15.916856    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b63804-dcff-4384-a940-f30a94f95705-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:25:17.180361 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:17.180327    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88b63804-dcff-4384-a940-f30a94f95705" path="/var/lib/kubelet/pods/88b63804-dcff-4384-a940-f30a94f95705/volumes"
Jul 20 18:25:20.112074 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:20.112029    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"]
Jul 20 18:25:20.112854 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:20.112835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:20.115777 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:20.115754    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fca5d313-fqrfk"]
Jul 20 18:25:20.537738 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:20.537666    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:21.180408 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:21.180358    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9169ccdb-e1b6-43d9-9460-d7b6433dc406" path="/var/lib/kubelet/pods/9169ccdb-e1b6-43d9-9460-d7b6433dc406/volumes"
Jul 20 18:25:26.570889 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:26.570859    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:26.656736 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:26.656701    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:26.962770 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:26.962737    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:27.181183 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:27.181157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:27.779371 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:27.779339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:27.875755 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:27.875723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:33.398867 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:33.398832    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:33.511559 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:33.511529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:33.634058 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:33.634032    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:33.764000 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:33.763889    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:39.535766 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:39.535729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:39.607846 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:39.607816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:46.472052 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:46.472017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:46.814767 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:46.814686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:47.272598 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:47.272550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:49.574880 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.574842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:49.653232 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.653201    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"]
Jul 20 18:25:49.653813 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.653797    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9169ccdb-e1b6-43d9-9460-d7b6433dc406" containerName="revoke-keys"
Jul 20 18:25:49.653876 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.653816    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9169ccdb-e1b6-43d9-9460-d7b6433dc406" containerName="revoke-keys"
Jul 20 18:25:49.653876 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.653838    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b63804-dcff-4384-a940-f30a94f95705" containerName="maas-api"
Jul 20 18:25:49.653876 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.653846    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b63804-dcff-4384-a940-f30a94f95705" containerName="maas-api"
Jul 20 18:25:49.653982 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.653955    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9169ccdb-e1b6-43d9-9460-d7b6433dc406" containerName="revoke-keys"
Jul 20 18:25:49.653982 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.653971    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="88b63804-dcff-4384-a940-f30a94f95705" containerName="maas-api"
Jul 20 18:25:49.657431 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.657410    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:49.660824 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.660805    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2be07642-serving-cert\""
Jul 20 18:25:49.669193 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.669169    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"]
Jul 20 18:25:49.673107 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.673086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:49.754986 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.754951    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnvgj\" (UniqueName: \"kubernetes.io/projected/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-kube-api-access-gnvgj\") pod \"maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:49.755197 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.755018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-maas-api-tls\") pod \"maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:49.755197 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.755067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-openshift-service-ca\") pod \"maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:49.755656 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.755631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:49.856161 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.856135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnvgj\" (UniqueName: \"kubernetes.io/projected/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-kube-api-access-gnvgj\") pod \"maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:49.856317 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.856178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-maas-api-tls\") pod \"maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:49.856317 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.856207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-openshift-service-ca\") pod \"maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:49.856884 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.856854    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-openshift-service-ca\") pod \"maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:49.858832 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.858804    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-maas-api-tls\") pod \"maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:49.861476 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.861455    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:49.872617 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.872596    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnvgj\" (UniqueName: \"kubernetes.io/projected/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-kube-api-access-gnvgj\") pod \"maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:49.970670 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:49.970639    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:50.114159 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:50.114134    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"]
Jul 20 18:25:50.116569 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:25:50.116542    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fac4b64_4d9d_4386_b94a_59a1ff44ad61.slice/crio-0534c7e384b36eeff8377bbe6c5e85bb55558fec273faffb9774c4feffdb51e8 WatchSource:0}: Error finding container 0534c7e384b36eeff8377bbe6c5e85bb55558fec273faffb9774c4feffdb51e8: Status 404 returned error can't find the container with id 0534c7e384b36eeff8377bbe6c5e85bb55558fec273faffb9774c4feffdb51e8
Jul 20 18:25:50.118334 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:50.118308    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:25:50.430446 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:50.430351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:50.532628 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:50.532576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:51.052610 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:51.052575    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c" event={"ID":"9fac4b64-4d9d-4386-b94a-59a1ff44ad61","Type":"ContainerStarted","Data":"ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5"}
Jul 20 18:25:51.053008 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:51.052637    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:51.053008 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:51.052660    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c" event={"ID":"9fac4b64-4d9d-4386-b94a-59a1ff44ad61","Type":"ContainerStarted","Data":"0534c7e384b36eeff8377bbe6c5e85bb55558fec273faffb9774c4feffdb51e8"}
Jul 20 18:25:51.073523 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:51.073473    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c" podStartSLOduration=1.7036650679999998 podStartE2EDuration="2.073457002s" totalImagesPullingTime="369.791934ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:25:51.072037454 +0000 UTC m=+2258.443630715" watchObservedRunningTime="2026-07-20 18:25:51.073457002 +0000 UTC m=+2258.445050260"
Jul 20 18:25:53.982142 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:53.982107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:25:57.064011 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:57.063981    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:25:57.534814 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:25:57.534755    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:17.364000 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:17.363963    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"]
Jul 20 18:26:17.367348 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:17.367332    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"
Jul 20 18:26:17.374358 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:17.374131    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:26:17.385506 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:17.385425    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"]
Jul 20 18:26:17.429371 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:17.429338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/058454e1-ff3c-49e8-b3e0-d1fdd8922181-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2be07642-zgjsj\" (UID: \"058454e1-ff3c-49e8-b3e0-d1fdd8922181\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"
Jul 20 18:26:17.530749 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:17.530708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/058454e1-ff3c-49e8-b3e0-d1fdd8922181-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2be07642-zgjsj\" (UID: \"058454e1-ff3c-49e8-b3e0-d1fdd8922181\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"
Jul 20 18:26:17.531451 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:17.531432    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/058454e1-ff3c-49e8-b3e0-d1fdd8922181-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2be07642-zgjsj\" (UID: \"058454e1-ff3c-49e8-b3e0-d1fdd8922181\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"
Jul 20 18:26:17.677617 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:17.677531    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"
Jul 20 18:26:17.831153 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:17.831130    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"]
Jul 20 18:26:17.833230 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:26:17.833199    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058454e1_ff3c_49e8_b3e0_d1fdd8922181.slice/crio-8a9cff92d118135f4a9ac451053eabce369989ac63c4eaf038eebcd93bce43e3 WatchSource:0}: Error finding container 8a9cff92d118135f4a9ac451053eabce369989ac63c4eaf038eebcd93bce43e3: Status 404 returned error can't find the container with id 8a9cff92d118135f4a9ac451053eabce369989ac63c4eaf038eebcd93bce43e3
Jul 20 18:26:18.200028 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:18.199989    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj" event={"ID":"058454e1-ff3c-49e8-b3e0-d1fdd8922181","Type":"ContainerStarted","Data":"3a6839879a8eda512f1e3f3b925513b368e35bce6546641cf7100a20a946e5e1"}
Jul 20 18:26:18.200218 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:18.200039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj" event={"ID":"058454e1-ff3c-49e8-b3e0-d1fdd8922181","Type":"ContainerStarted","Data":"8a9cff92d118135f4a9ac451053eabce369989ac63c4eaf038eebcd93bce43e3"}
Jul 20 18:26:18.222355 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:18.222307    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj" podStartSLOduration=1.222291377 podStartE2EDuration="1.222291377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:26:18.221647439 +0000 UTC m=+2285.593240699" watchObservedRunningTime="2026-07-20 18:26:18.222291377 +0000 UTC m=+2285.593884635"
Jul 20 18:26:19.206402 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:19.206370    2562 generic.go:356] "Generic (PLEG): container finished" podID="058454e1-ff3c-49e8-b3e0-d1fdd8922181" containerID="3a6839879a8eda512f1e3f3b925513b368e35bce6546641cf7100a20a946e5e1" exitCode=0
Jul 20 18:26:19.206809 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:19.206457    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj" event={"ID":"058454e1-ff3c-49e8-b3e0-d1fdd8922181","Type":"ContainerDied","Data":"3a6839879a8eda512f1e3f3b925513b368e35bce6546641cf7100a20a946e5e1"}
Jul 20 18:26:20.339718 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:20.339693    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"
Jul 20 18:26:20.357643 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:20.357620    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/058454e1-ff3c-49e8-b3e0-d1fdd8922181-maas-api-service-ca\") pod \"058454e1-ff3c-49e8-b3e0-d1fdd8922181\" (UID: \"058454e1-ff3c-49e8-b3e0-d1fdd8922181\") "
Jul 20 18:26:20.357935 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:20.357915    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/058454e1-ff3c-49e8-b3e0-d1fdd8922181-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "058454e1-ff3c-49e8-b3e0-d1fdd8922181" (UID: "058454e1-ff3c-49e8-b3e0-d1fdd8922181"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:26:20.459136 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:20.459098    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/058454e1-ff3c-49e8-b3e0-d1fdd8922181-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:26:21.217161 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:21.217138    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"
Jul 20 18:26:21.217331 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:21.217127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj" event={"ID":"058454e1-ff3c-49e8-b3e0-d1fdd8922181","Type":"ContainerDied","Data":"8a9cff92d118135f4a9ac451053eabce369989ac63c4eaf038eebcd93bce43e3"}
Jul 20 18:26:21.217331 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:21.217260    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a9cff92d118135f4a9ac451053eabce369989ac63c4eaf038eebcd93bce43e3"
Jul 20 18:26:32.913093 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:32.913055    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"]
Jul 20 18:26:32.913648 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:32.913274    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c" podUID="9fac4b64-4d9d-4386-b94a-59a1ff44ad61" containerName="maas-api" containerID="cri-o://ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5" gracePeriod=30
Jul 20 18:26:32.933081 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:32.933023    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:33.157859 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.157831    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:26:33.278660 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.278583    2562 generic.go:356] "Generic (PLEG): container finished" podID="9fac4b64-4d9d-4386-b94a-59a1ff44ad61" containerID="ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5" exitCode=0
Jul 20 18:26:33.278660 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.278622    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"
Jul 20 18:26:33.278660 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.278655    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c" event={"ID":"9fac4b64-4d9d-4386-b94a-59a1ff44ad61","Type":"ContainerDied","Data":"ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5"}
Jul 20 18:26:33.278923 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.278702    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c" event={"ID":"9fac4b64-4d9d-4386-b94a-59a1ff44ad61","Type":"ContainerDied","Data":"0534c7e384b36eeff8377bbe6c5e85bb55558fec273faffb9774c4feffdb51e8"}
Jul 20 18:26:33.278923 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.278726    2562 scope.go:117] "RemoveContainer" containerID="ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5"
Jul 20 18:26:33.286338 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.286317    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-openshift-service-ca\") pod \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") "
Jul 20 18:26:33.286474 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.286460    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnvgj\" (UniqueName: \"kubernetes.io/projected/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-kube-api-access-gnvgj\") pod \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") "
Jul 20 18:26:33.286530 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.286487    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-maas-api-tls\") pod \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\" (UID: \"9fac4b64-4d9d-4386-b94a-59a1ff44ad61\") "
Jul 20 18:26:33.286770 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.286731    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9fac4b64-4d9d-4386-b94a-59a1ff44ad61" (UID: "9fac4b64-4d9d-4386-b94a-59a1ff44ad61"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:26:33.287025 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.287001    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:26:33.288611 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.288595    2562 scope.go:117] "RemoveContainer" containerID="ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5"
Jul 20 18:26:33.288688 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.288615    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-kube-api-access-gnvgj" (OuterVolumeSpecName: "kube-api-access-gnvgj") pod "9fac4b64-4d9d-4386-b94a-59a1ff44ad61" (UID: "9fac4b64-4d9d-4386-b94a-59a1ff44ad61"). InnerVolumeSpecName "kube-api-access-gnvgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:26:33.288772 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.288753    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9fac4b64-4d9d-4386-b94a-59a1ff44ad61" (UID: "9fac4b64-4d9d-4386-b94a-59a1ff44ad61"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:26:33.288892 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:26:33.288875    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5\": container with ID starting with ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5 not found: ID does not exist" containerID="ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5"
Jul 20 18:26:33.288951 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.288900    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5"} err="failed to get container status \"ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5\": rpc error: code = NotFound desc = could not find container \"ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5\": container with ID starting with ba281bd520237e8103533c7432e2df8357a6371f008abc5e8e6b638043e77fc5 not found: ID does not exist"
Jul 20 18:26:33.388516 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.388477    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnvgj\" (UniqueName: \"kubernetes.io/projected/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-kube-api-access-gnvgj\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:26:33.388516 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.388508    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fac4b64-4d9d-4386-b94a-59a1ff44ad61-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:26:33.610323 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.610294    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"]
Jul 20 18:26:33.617669 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:33.617637    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2be07642-5d8f7ccb95-b667c"]
Jul 20 18:26:35.181061 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:35.181028    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fac4b64-4d9d-4386-b94a-59a1ff44ad61" path="/var/lib/kubelet/pods/9fac4b64-4d9d-4386-b94a-59a1ff44ad61/volumes"
Jul 20 18:26:37.521961 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:37.521921    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:37.532907 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:37.532881    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"]
Jul 20 18:26:37.544759 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:37.544735    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2be07642-zgjsj"]
Jul 20 18:26:39.181109 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:39.181072    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="058454e1-ff3c-49e8-b3e0-d1fdd8922181" path="/var/lib/kubelet/pods/058454e1-ff3c-49e8-b3e0-d1fdd8922181/volumes"
Jul 20 18:26:39.952101 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:39.952069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:26:44.968236 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:26:44.968207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:13.312570 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:13.312483    2562 scope.go:117] "RemoveContainer" containerID="ba36f917dcd55a84ebb832f4f1008b52f1825e41e0d92ead78f3455556f0ae69"
Jul 20 18:27:21.280225 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:21.280178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:22.049875 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:22.049832    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:22.855309 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:22.855258    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:28.665283 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:28.665254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:34.409045 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:34.408990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:34.516082 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:34.516050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:34.722297 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:34.722190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:34.955852 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:34.955805    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:36.206227 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:36.206182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:36.359014 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:36.358986    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:37.256410 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:37.256370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:37.362120 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:37.362084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:48.460507 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:48.460470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:48.565017 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:48.564987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:51.850733 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:51.850653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:27:59.053534 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:27:59.053495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:02.235049 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:02.235008    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:02.354765 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:02.354723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:05.178076 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:05.178032    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:05.279034 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:05.279006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:06.045049 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:06.045017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:12.777187 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:12.777136    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:12.893575 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:12.893539    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:12.979751 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:12.979715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:13.254166 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:13.254141    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:28:13.257498 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:13.257478    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:28:13.340543 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:13.340513    2562 scope.go:117] "RemoveContainer" containerID="699ae7c9e4c653ecc4c0822a8aaa0be7b7b26781d41c2b989732841f285a973f"
Jul 20 18:28:13.350405 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:13.350368    2562 scope.go:117] "RemoveContainer" containerID="95e2d043007871897de526c49ce2f9d0e86bb650ca6898d76b4c0c95c7a6969a"
Jul 20 18:28:14.469012 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:14.468980    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:23.567117 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:23.567075    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:23.920032 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:23.919997    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:44.967698 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:44.967617    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:52.711604 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:52.711565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:52.784704 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:52.784672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:53.078222 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:53.078126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:53.471887 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:53.471858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:53.674810 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:53.674780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:56.437373 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.437337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:56.556569 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.556541    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"]
Jul 20 18:28:56.556941 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.556929    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fac4b64-4d9d-4386-b94a-59a1ff44ad61" containerName="maas-api"
Jul 20 18:28:56.556993 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.556943    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fac4b64-4d9d-4386-b94a-59a1ff44ad61" containerName="maas-api"
Jul 20 18:28:56.556993 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.556954    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="058454e1-ff3c-49e8-b3e0-d1fdd8922181" containerName="revoke-keys"
Jul 20 18:28:56.556993 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.556959    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="058454e1-ff3c-49e8-b3e0-d1fdd8922181" containerName="revoke-keys"
Jul 20 18:28:56.557098 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.557019    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fac4b64-4d9d-4386-b94a-59a1ff44ad61" containerName="maas-api"
Jul 20 18:28:56.557098 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.557030    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="058454e1-ff3c-49e8-b3e0-d1fdd8922181" containerName="revoke-keys"
Jul 20 18:28:56.560142 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.560115    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:56.563519 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.563493    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-9b1a57-serving-cert\""
Jul 20 18:28:56.579113 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.579085    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"]
Jul 20 18:28:56.581632 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.581606    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:56.673720 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.673679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5f43a0-01db-4d78-a53e-7c3686d93484-maas-api-tls\") pod \"maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:56.673895 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.673842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpp2r\" (UniqueName: \"kubernetes.io/projected/7a5f43a0-01db-4d78-a53e-7c3686d93484-kube-api-access-fpp2r\") pod \"maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:56.673895 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.673872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5f43a0-01db-4d78-a53e-7c3686d93484-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:56.683150 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.683122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:56.774463 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.774351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpp2r\" (UniqueName: \"kubernetes.io/projected/7a5f43a0-01db-4d78-a53e-7c3686d93484-kube-api-access-fpp2r\") pod \"maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:56.774463 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.774385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5f43a0-01db-4d78-a53e-7c3686d93484-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:56.774463 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.774445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5f43a0-01db-4d78-a53e-7c3686d93484-maas-api-tls\") pod \"maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:56.775110 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.775087    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5f43a0-01db-4d78-a53e-7c3686d93484-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:56.776941 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.776918    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5f43a0-01db-4d78-a53e-7c3686d93484-maas-api-tls\") pod \"maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:56.784462 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.784436    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpp2r\" (UniqueName: \"kubernetes.io/projected/7a5f43a0-01db-4d78-a53e-7c3686d93484-kube-api-access-fpp2r\") pod \"maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:56.809957 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.809923    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:56.870870 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:56.870841    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:57.207816 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:57.207786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:57.235903 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:57.235880    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"]
Jul 20 18:28:57.238132 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:28:57.238109    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5f43a0_01db_4d78_a53e_7c3686d93484.slice/crio-7a5d25089f14d9f6b8098e1d568919252c71ebbf782855e0c1eee9727c5777e0 WatchSource:0}: Error finding container 7a5d25089f14d9f6b8098e1d568919252c71ebbf782855e0c1eee9727c5777e0: Status 404 returned error can't find the container with id 7a5d25089f14d9f6b8098e1d568919252c71ebbf782855e0c1eee9727c5777e0
Jul 20 18:28:57.336597 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:57.336560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:28:58.037816 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:58.037735    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql" event={"ID":"7a5f43a0-01db-4d78-a53e-7c3686d93484","Type":"ContainerStarted","Data":"dcfc683845992c150c859006dad2ff8bc103dc0011850986985192e6a0f73150"}
Jul 20 18:28:58.037816 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:58.037788    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql" event={"ID":"7a5f43a0-01db-4d78-a53e-7c3686d93484","Type":"ContainerStarted","Data":"7a5d25089f14d9f6b8098e1d568919252c71ebbf782855e0c1eee9727c5777e0"}
Jul 20 18:28:58.038199 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:58.037888    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:28:58.057483 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:28:58.057429    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql" podStartSLOduration=1.6292246879999999 podStartE2EDuration="2.057385838s" totalImagesPullingTime="428.16115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:28:58.057004001 +0000 UTC m=+2445.428597261" watchObservedRunningTime="2026-07-20 18:28:58.057385838 +0000 UTC m=+2445.428979096"
Jul 20 18:29:00.950336 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:00.950302    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:01.344856 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:01.344824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:01.700805 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:01.700722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:02.045719 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:02.045621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:04.048975 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:04.048946    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:29:04.733227 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:04.733191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:04.825131 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:04.825092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:04.932163 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:04.932126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:04.946776 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:04.946744    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"]
Jul 20 18:29:04.951233 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:04.951212    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:04.953978 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:04.953957    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e73607-serving-cert\""
Jul 20 18:29:04.968141 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:04.968120    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"]
Jul 20 18:29:05.056207 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.056127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rn6m\" (UniqueName: \"kubernetes.io/projected/a161682d-f334-4940-aa9c-b62f36ae6d49-kube-api-access-9rn6m\") pod \"maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:05.056207 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.056188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a161682d-f334-4940-aa9c-b62f36ae6d49-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:05.056623 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.056249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a161682d-f334-4940-aa9c-b62f36ae6d49-maas-api-tls\") pod \"maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:05.157646 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.157612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rn6m\" (UniqueName: \"kubernetes.io/projected/a161682d-f334-4940-aa9c-b62f36ae6d49-kube-api-access-9rn6m\") pod \"maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:05.157857 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.157707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a161682d-f334-4940-aa9c-b62f36ae6d49-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:05.157857 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.157749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a161682d-f334-4940-aa9c-b62f36ae6d49-maas-api-tls\") pod \"maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:05.157969 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:29:05.157874    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-serving-cert: secret "maas-api-e2e-inf-b-e73607-serving-cert" not found
Jul 20 18:29:05.157969 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:29:05.157936    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a161682d-f334-4940-aa9c-b62f36ae6d49-maas-api-tls podName:a161682d-f334-4940-aa9c-b62f36ae6d49 nodeName:}" failed. No retries permitted until 2026-07-20 18:29:05.657919446 +0000 UTC m=+2453.029512683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a161682d-f334-4940-aa9c-b62f36ae6d49-maas-api-tls") pod "maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k" (UID: "a161682d-f334-4940-aa9c-b62f36ae6d49") : secret "maas-api-e2e-inf-b-e73607-serving-cert" not found
Jul 20 18:29:05.158333 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.158312    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a161682d-f334-4940-aa9c-b62f36ae6d49-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:05.168143 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.168123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rn6m\" (UniqueName: \"kubernetes.io/projected/a161682d-f334-4940-aa9c-b62f36ae6d49-kube-api-access-9rn6m\") pod \"maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:05.267976 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.267935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:05.431074 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.431045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:05.581174 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.581141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:05.661686 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.661651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a161682d-f334-4940-aa9c-b62f36ae6d49-maas-api-tls\") pod \"maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:05.664214 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.664194    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a161682d-f334-4940-aa9c-b62f36ae6d49-maas-api-tls\") pod \"maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:05.861929 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:05.861893    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:06.009077 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:06.009053    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"]
Jul 20 18:29:06.011430 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:29:06.011374    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda161682d_f334_4940_aa9c_b62f36ae6d49.slice/crio-e18b20f3a41c80572b350b57bbc50e6ede3e002be653f309a10f6d81b3865c2d WatchSource:0}: Error finding container e18b20f3a41c80572b350b57bbc50e6ede3e002be653f309a10f6d81b3865c2d: Status 404 returned error can't find the container with id e18b20f3a41c80572b350b57bbc50e6ede3e002be653f309a10f6d81b3865c2d
Jul 20 18:29:06.082137 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:06.082104    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k" event={"ID":"a161682d-f334-4940-aa9c-b62f36ae6d49","Type":"ContainerStarted","Data":"e18b20f3a41c80572b350b57bbc50e6ede3e002be653f309a10f6d81b3865c2d"}
Jul 20 18:29:07.097786 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:07.097746    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k" event={"ID":"a161682d-f334-4940-aa9c-b62f36ae6d49","Type":"ContainerStarted","Data":"621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5"}
Jul 20 18:29:07.098284 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:07.097854    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:07.119019 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:07.118973    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k" podStartSLOduration=2.617109437 podStartE2EDuration="3.118959628s" totalImagesPullingTime="501.850191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:29:07.115868426 +0000 UTC m=+2454.487461684" watchObservedRunningTime="2026-07-20 18:29:07.118959628 +0000 UTC m=+2454.490552886"
Jul 20 18:29:09.348153 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:09.348123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:13.108513 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:13.108484    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:29:13.378777 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:13.378696    2562 scope.go:117] "RemoveContainer" containerID="d41c60d3a7d09f37befad6fb19010df310b4b439f3f0551d3ed98f90b348fba6"
Jul 20 18:29:18.156978 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:18.156932    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:18.250853 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:18.250819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:22.591965 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:22.591925    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:26.439992 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:26.439951    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:26.538214 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:26.538183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:29:48.326181 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:29:48.326153    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:00.138155 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.138111    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb"]
Jul 20 18:30:00.141823 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.141799    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5"]
Jul 20 18:30:00.141957 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.141915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb"
Jul 20 18:30:00.144649 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.144616    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:30:00.145010 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.144995    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4"]
Jul 20 18:30:00.145134 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.145117    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5"
Jul 20 18:30:00.148744 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.148726    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4"
Jul 20 18:30:00.151124 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.151105    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb"]
Jul 20 18:30:00.153821 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.153791    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5"]
Jul 20 18:30:00.155124 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.155103    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb"
Jul 20 18:30:00.164673 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.164652    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5"
Jul 20 18:30:00.173837 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.173243    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4"]
Jul 20 18:30:00.210322 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.210295    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4"
Jul 20 18:30:00.334612 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.334544    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb"]
Jul 20 18:30:00.338407 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:30:00.338359    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7bd21be_57a9_4415_919a_91ed28d3b806.slice/crio-d4c1020d3eea1efbfc6fe1e85b6ef89f7faa2bfd6df87452a097b526a46ddce0 WatchSource:0}: Error finding container d4c1020d3eea1efbfc6fe1e85b6ef89f7faa2bfd6df87452a097b526a46ddce0: Status 404 returned error can't find the container with id d4c1020d3eea1efbfc6fe1e85b6ef89f7faa2bfd6df87452a097b526a46ddce0
Jul 20 18:30:00.358755 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:30:00.358715    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31fd1d8_55ec_45ee_808a_93e6dd24c855.slice/crio-3af293ff7e5934774079cc341790d3f2eaacde5690f1d1cbffc226669788a865 WatchSource:0}: Error finding container 3af293ff7e5934774079cc341790d3f2eaacde5690f1d1cbffc226669788a865: Status 404 returned error can't find the container with id 3af293ff7e5934774079cc341790d3f2eaacde5690f1d1cbffc226669788a865
Jul 20 18:30:00.358908 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.358880    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5"]
Jul 20 18:30:00.386848 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.386814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb" event={"ID":"b7bd21be-57a9-4415-919a-91ed28d3b806","Type":"ContainerStarted","Data":"d4c1020d3eea1efbfc6fe1e85b6ef89f7faa2bfd6df87452a097b526a46ddce0"}
Jul 20 18:30:00.389247 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.389171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5" event={"ID":"d31fd1d8-55ec-45ee-808a-93e6dd24c855","Type":"ContainerStarted","Data":"3af293ff7e5934774079cc341790d3f2eaacde5690f1d1cbffc226669788a865"}
Jul 20 18:30:00.391465 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:00.391443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4"]
Jul 20 18:30:00.393618 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:30:00.393594    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7d84e0_983c_4ac7_8ad1_a3fde1675df0.slice/crio-85c79256e2f51a3023f954258a3e775b4358f73e0dd260b59dcbf16ed9a77d8f WatchSource:0}: Error finding container 85c79256e2f51a3023f954258a3e775b4358f73e0dd260b59dcbf16ed9a77d8f: Status 404 returned error can't find the container with id 85c79256e2f51a3023f954258a3e775b4358f73e0dd260b59dcbf16ed9a77d8f
Jul 20 18:30:01.395983 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:01.395952    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4" event={"ID":"9e7d84e0-983c-4ac7-8ad1-a3fde1675df0","Type":"ContainerStarted","Data":"a65113ceaf525bd2c240d726caf09e29d31e5ac67fb9f4b4d8c80ccf0ad68d15"}
Jul 20 18:30:01.396373 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:01.396011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4" event={"ID":"9e7d84e0-983c-4ac7-8ad1-a3fde1675df0","Type":"ContainerStarted","Data":"85c79256e2f51a3023f954258a3e775b4358f73e0dd260b59dcbf16ed9a77d8f"}
Jul 20 18:30:01.397378 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:01.397352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb" event={"ID":"b7bd21be-57a9-4415-919a-91ed28d3b806","Type":"ContainerStarted","Data":"a0c48ae5bfbf1a5bfe2292581a921e2da9799da1dd5345415852e7d806f44b48"}
Jul 20 18:30:01.398806 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:01.398783    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5" event={"ID":"d31fd1d8-55ec-45ee-808a-93e6dd24c855","Type":"ContainerStarted","Data":"4f62e3b31af601dd4dcef035f6c046d4a1cb714fd1aa930050817a99a5d3e8ef"}
Jul 20 18:30:01.416866 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:01.416826    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4" podStartSLOduration=1.416810852 podStartE2EDuration="1.416810852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:30:01.416009826 +0000 UTC m=+2508.787603086" watchObservedRunningTime="2026-07-20 18:30:01.416810852 +0000 UTC m=+2508.788404111"
Jul 20 18:30:01.435328 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:01.435287    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb" podStartSLOduration=1.435271641 podStartE2EDuration="1.435271641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:30:01.433686336 +0000 UTC m=+2508.805279596" watchObservedRunningTime="2026-07-20 18:30:01.435271641 +0000 UTC m=+2508.806864900"
Jul 20 18:30:01.452898 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:01.452844    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5" podStartSLOduration=1.452830978 podStartE2EDuration="1.452830978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:30:01.450722781 +0000 UTC m=+2508.822316040" watchObservedRunningTime="2026-07-20 18:30:01.452830978 +0000 UTC m=+2508.824424240"
Jul 20 18:30:02.405466 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:02.405430    2562 generic.go:356] "Generic (PLEG): container finished" podID="b7bd21be-57a9-4415-919a-91ed28d3b806" containerID="a0c48ae5bfbf1a5bfe2292581a921e2da9799da1dd5345415852e7d806f44b48" exitCode=0
Jul 20 18:30:02.405896 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:02.405500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb" event={"ID":"b7bd21be-57a9-4415-919a-91ed28d3b806","Type":"ContainerDied","Data":"a0c48ae5bfbf1a5bfe2292581a921e2da9799da1dd5345415852e7d806f44b48"}
Jul 20 18:30:02.406956 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:02.406929    2562 generic.go:356] "Generic (PLEG): container finished" podID="d31fd1d8-55ec-45ee-808a-93e6dd24c855" containerID="4f62e3b31af601dd4dcef035f6c046d4a1cb714fd1aa930050817a99a5d3e8ef" exitCode=0
Jul 20 18:30:02.407094 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:02.407008    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5" event={"ID":"d31fd1d8-55ec-45ee-808a-93e6dd24c855","Type":"ContainerDied","Data":"4f62e3b31af601dd4dcef035f6c046d4a1cb714fd1aa930050817a99a5d3e8ef"}
Jul 20 18:30:02.408429 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:02.408387    2562 generic.go:356] "Generic (PLEG): container finished" podID="9e7d84e0-983c-4ac7-8ad1-a3fde1675df0" containerID="a65113ceaf525bd2c240d726caf09e29d31e5ac67fb9f4b4d8c80ccf0ad68d15" exitCode=0
Jul 20 18:30:02.408531 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:02.408433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4" event={"ID":"9e7d84e0-983c-4ac7-8ad1-a3fde1675df0","Type":"ContainerDied","Data":"a65113ceaf525bd2c240d726caf09e29d31e5ac67fb9f4b4d8c80ccf0ad68d15"}
Jul 20 18:30:03.546026 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:03.546003    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb"
Jul 20 18:30:03.595736 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:03.595713    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5"
Jul 20 18:30:03.619809 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:03.619785    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4"
Jul 20 18:30:04.420570 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:04.420543    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5"
Jul 20 18:30:04.420757 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:04.420589    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5" event={"ID":"d31fd1d8-55ec-45ee-808a-93e6dd24c855","Type":"ContainerDied","Data":"3af293ff7e5934774079cc341790d3f2eaacde5690f1d1cbffc226669788a865"}
Jul 20 18:30:04.420757 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:04.420640    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3af293ff7e5934774079cc341790d3f2eaacde5690f1d1cbffc226669788a865"
Jul 20 18:30:04.421914 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:04.421896    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4"
Jul 20 18:30:04.421914 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:04.421911    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4" event={"ID":"9e7d84e0-983c-4ac7-8ad1-a3fde1675df0","Type":"ContainerDied","Data":"85c79256e2f51a3023f954258a3e775b4358f73e0dd260b59dcbf16ed9a77d8f"}
Jul 20 18:30:04.422126 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:04.421950    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85c79256e2f51a3023f954258a3e775b4358f73e0dd260b59dcbf16ed9a77d8f"
Jul 20 18:30:04.423322 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:04.423303    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb"
Jul 20 18:30:04.423435 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:04.423319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742870-w8hgb" event={"ID":"b7bd21be-57a9-4415-919a-91ed28d3b806","Type":"ContainerDied","Data":"d4c1020d3eea1efbfc6fe1e85b6ef89f7faa2bfd6df87452a097b526a46ddce0"}
Jul 20 18:30:04.423435 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:04.423365    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4c1020d3eea1efbfc6fe1e85b6ef89f7faa2bfd6df87452a097b526a46ddce0"
Jul 20 18:30:29.804346 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:29.804287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:30.858859 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.858826    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"]
Jul 20 18:30:30.859473 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.859449    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e7d84e0-983c-4ac7-8ad1-a3fde1675df0" containerName="cleanup"
Jul 20 18:30:30.859473 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.859468    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e7d84e0-983c-4ac7-8ad1-a3fde1675df0" containerName="cleanup"
Jul 20 18:30:30.859612 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.859522    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7bd21be-57a9-4415-919a-91ed28d3b806" containerName="cleanup"
Jul 20 18:30:30.859612 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.859531    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7bd21be-57a9-4415-919a-91ed28d3b806" containerName="cleanup"
Jul 20 18:30:30.859612 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.859541    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d31fd1d8-55ec-45ee-808a-93e6dd24c855" containerName="cleanup"
Jul 20 18:30:30.859612 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.859550    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d31fd1d8-55ec-45ee-808a-93e6dd24c855" containerName="cleanup"
Jul 20 18:30:30.859803 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.859652    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d31fd1d8-55ec-45ee-808a-93e6dd24c855" containerName="cleanup"
Jul 20 18:30:30.859803 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.859667    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e7d84e0-983c-4ac7-8ad1-a3fde1675df0" containerName="cleanup"
Jul 20 18:30:30.859803 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.859679    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7bd21be-57a9-4415-919a-91ed28d3b806" containerName="cleanup"
Jul 20 18:30:30.863011 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.862992    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"
Jul 20 18:30:30.865634 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.865613    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:30:30.872157 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.872132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"]
Jul 20 18:30:30.985770 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:30.985735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9c6a81-06bb-41db-b834-d79299d3030d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7\" (UID: \"db9c6a81-06bb-41db-b834-d79299d3030d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"
Jul 20 18:30:31.086843 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:31.086805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9c6a81-06bb-41db-b834-d79299d3030d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7\" (UID: \"db9c6a81-06bb-41db-b834-d79299d3030d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"
Jul 20 18:30:31.087479 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:31.087461    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9c6a81-06bb-41db-b834-d79299d3030d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7\" (UID: \"db9c6a81-06bb-41db-b834-d79299d3030d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"
Jul 20 18:30:31.174292 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:31.174207    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"
Jul 20 18:30:31.326716 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:31.326597    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"]
Jul 20 18:30:31.329722 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:30:31.329692    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9c6a81_06bb_41db_b834_d79299d3030d.slice/crio-b868f5fee71c550cf964b331e3c4d1ee5a686c4ea44c1eba8fe382a1ddb51150 WatchSource:0}: Error finding container b868f5fee71c550cf964b331e3c4d1ee5a686c4ea44c1eba8fe382a1ddb51150: Status 404 returned error can't find the container with id b868f5fee71c550cf964b331e3c4d1ee5a686c4ea44c1eba8fe382a1ddb51150
Jul 20 18:30:31.574600 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:31.574563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7" event={"ID":"db9c6a81-06bb-41db-b834-d79299d3030d","Type":"ContainerStarted","Data":"b868f5fee71c550cf964b331e3c4d1ee5a686c4ea44c1eba8fe382a1ddb51150"}
Jul 20 18:30:32.141772 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:32.141716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:32.580956 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:32.580923    2562 generic.go:356] "Generic (PLEG): container finished" podID="db9c6a81-06bb-41db-b834-d79299d3030d" containerID="142f43b2c860a70f72d95967ded10b6a8adc265e1f4aeee189adb9333cf29569" exitCode=0
Jul 20 18:30:32.581131 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:32.581009    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7" event={"ID":"db9c6a81-06bb-41db-b834-d79299d3030d","Type":"ContainerDied","Data":"142f43b2c860a70f72d95967ded10b6a8adc265e1f4aeee189adb9333cf29569"}
Jul 20 18:30:33.719091 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:33.719068    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"
Jul 20 18:30:33.812476 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:33.812443    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9c6a81-06bb-41db-b834-d79299d3030d-maas-api-service-ca\") pod \"db9c6a81-06bb-41db-b834-d79299d3030d\" (UID: \"db9c6a81-06bb-41db-b834-d79299d3030d\") "
Jul 20 18:30:33.812799 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:33.812777    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db9c6a81-06bb-41db-b834-d79299d3030d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "db9c6a81-06bb-41db-b834-d79299d3030d" (UID: "db9c6a81-06bb-41db-b834-d79299d3030d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:30:33.913641 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:33.913606    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9c6a81-06bb-41db-b834-d79299d3030d-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:30:34.592776 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:34.592748    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"
Jul 20 18:30:34.592977 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:34.592793    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7" event={"ID":"db9c6a81-06bb-41db-b834-d79299d3030d","Type":"ContainerDied","Data":"b868f5fee71c550cf964b331e3c4d1ee5a686c4ea44c1eba8fe382a1ddb51150"}
Jul 20 18:30:34.592977 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:34.592843    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b868f5fee71c550cf964b331e3c4d1ee5a686c4ea44c1eba8fe382a1ddb51150"
Jul 20 18:30:41.306426 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.306375    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"]
Jul 20 18:30:41.306855 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.306610    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql" podUID="7a5f43a0-01db-4d78-a53e-7c3686d93484" containerName="maas-api" containerID="cri-o://dcfc683845992c150c859006dad2ff8bc103dc0011850986985192e6a0f73150" gracePeriod=30
Jul 20 18:30:41.336902 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.336865    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:41.338074 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.338046    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5"]
Jul 20 18:30:41.342255 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.342234    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9b1a57-29742870-mm2z5"]
Jul 20 18:30:41.630157 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.630112    2562 generic.go:356] "Generic (PLEG): container finished" podID="7a5f43a0-01db-4d78-a53e-7c3686d93484" containerID="dcfc683845992c150c859006dad2ff8bc103dc0011850986985192e6a0f73150" exitCode=0
Jul 20 18:30:41.630298 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.630179    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql" event={"ID":"7a5f43a0-01db-4d78-a53e-7c3686d93484","Type":"ContainerDied","Data":"dcfc683845992c150c859006dad2ff8bc103dc0011850986985192e6a0f73150"}
Jul 20 18:30:41.752875 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.752852    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:30:41.789521 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.789494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5f43a0-01db-4d78-a53e-7c3686d93484-openshift-service-ca\") pod \"7a5f43a0-01db-4d78-a53e-7c3686d93484\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") "
Jul 20 18:30:41.789694 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.789549    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpp2r\" (UniqueName: \"kubernetes.io/projected/7a5f43a0-01db-4d78-a53e-7c3686d93484-kube-api-access-fpp2r\") pod \"7a5f43a0-01db-4d78-a53e-7c3686d93484\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") "
Jul 20 18:30:41.789845 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.789823    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a5f43a0-01db-4d78-a53e-7c3686d93484-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a5f43a0-01db-4d78-a53e-7c3686d93484" (UID: "7a5f43a0-01db-4d78-a53e-7c3686d93484"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:30:41.791778 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.791758    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a5f43a0-01db-4d78-a53e-7c3686d93484-kube-api-access-fpp2r" (OuterVolumeSpecName: "kube-api-access-fpp2r") pod "7a5f43a0-01db-4d78-a53e-7c3686d93484" (UID: "7a5f43a0-01db-4d78-a53e-7c3686d93484"). InnerVolumeSpecName "kube-api-access-fpp2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:30:41.890200 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.890165    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5f43a0-01db-4d78-a53e-7c3686d93484-maas-api-tls\") pod \"7a5f43a0-01db-4d78-a53e-7c3686d93484\" (UID: \"7a5f43a0-01db-4d78-a53e-7c3686d93484\") "
Jul 20 18:30:41.890453 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.890437    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpp2r\" (UniqueName: \"kubernetes.io/projected/7a5f43a0-01db-4d78-a53e-7c3686d93484-kube-api-access-fpp2r\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:30:41.890531 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.890458    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5f43a0-01db-4d78-a53e-7c3686d93484-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:30:41.892330 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.892307    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a5f43a0-01db-4d78-a53e-7c3686d93484-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a5f43a0-01db-4d78-a53e-7c3686d93484" (UID: "7a5f43a0-01db-4d78-a53e-7c3686d93484"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:30:41.995456 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:41.991214    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5f43a0-01db-4d78-a53e-7c3686d93484-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:30:42.636561 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:42.636530    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql" event={"ID":"7a5f43a0-01db-4d78-a53e-7c3686d93484","Type":"ContainerDied","Data":"7a5d25089f14d9f6b8098e1d568919252c71ebbf782855e0c1eee9727c5777e0"}
Jul 20 18:30:42.637015 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:42.636573    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"
Jul 20 18:30:42.637015 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:42.636596    2562 scope.go:117] "RemoveContainer" containerID="dcfc683845992c150c859006dad2ff8bc103dc0011850986985192e6a0f73150"
Jul 20 18:30:42.659018 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:42.658989    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"]
Jul 20 18:30:42.663060 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:42.663036    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9b1a57-5fbc4bbdfd-7zlql"]
Jul 20 18:30:43.182152 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:43.182117    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a5f43a0-01db-4d78-a53e-7c3686d93484" path="/var/lib/kubelet/pods/7a5f43a0-01db-4d78-a53e-7c3686d93484/volumes"
Jul 20 18:30:43.182424 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:43.182411    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d31fd1d8-55ec-45ee-808a-93e6dd24c855" path="/var/lib/kubelet/pods/d31fd1d8-55ec-45ee-808a-93e6dd24c855/volumes"
Jul 20 18:30:45.943284 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:45.943232    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:45.958479 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:45.958449    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"]
Jul 20 18:30:45.962247 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:45.962226    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9b1a57-5k6r7"]
Jul 20 18:30:46.589321 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:46.589291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:47.180567 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:47.180534    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db9c6a81-06bb-41db-b834-d79299d3030d" path="/var/lib/kubelet/pods/db9c6a81-06bb-41db-b834-d79299d3030d/volumes"
Jul 20 18:30:52.647576 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:52.647544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:52.754561 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:52.754527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:53.240903 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.240866    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:53.369999 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.369968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:53.486817 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.486788    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"]
Jul 20 18:30:53.487209 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.487194    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a5f43a0-01db-4d78-a53e-7c3686d93484" containerName="maas-api"
Jul 20 18:30:53.487209 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.487210    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a5f43a0-01db-4d78-a53e-7c3686d93484" containerName="maas-api"
Jul 20 18:30:53.487348 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.487236    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db9c6a81-06bb-41db-b834-d79299d3030d" containerName="revoke-keys"
Jul 20 18:30:53.487348 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.487244    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="db9c6a81-06bb-41db-b834-d79299d3030d" containerName="revoke-keys"
Jul 20 18:30:53.487348 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.487324    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="db9c6a81-06bb-41db-b834-d79299d3030d" containerName="revoke-keys"
Jul 20 18:30:53.487348 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.487333    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a5f43a0-01db-4d78-a53e-7c3686d93484" containerName="maas-api"
Jul 20 18:30:53.489499 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.489481    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"
Jul 20 18:30:53.492566 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.492511    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:30:53.499696 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.499669    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"]
Jul 20 18:30:53.601373 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.601337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e51f7387-3743-46cf-9eb0-1bd994367927-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8\" (UID: \"e51f7387-3743-46cf-9eb0-1bd994367927\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"
Jul 20 18:30:53.702087 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.702050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e51f7387-3743-46cf-9eb0-1bd994367927-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8\" (UID: \"e51f7387-3743-46cf-9eb0-1bd994367927\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"
Jul 20 18:30:53.702892 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.702873    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e51f7387-3743-46cf-9eb0-1bd994367927-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8\" (UID: \"e51f7387-3743-46cf-9eb0-1bd994367927\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"
Jul 20 18:30:53.801933 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.801856    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"
Jul 20 18:30:53.950135 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:53.950108    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"]
Jul 20 18:30:53.951001 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:30:53.950968    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51f7387_3743_46cf_9eb0_1bd994367927.slice/crio-4f5f8e6d3e660900fe01c452db9a20dfebe90aef5d2ca3eb900bfbc590880ee0 WatchSource:0}: Error finding container 4f5f8e6d3e660900fe01c452db9a20dfebe90aef5d2ca3eb900bfbc590880ee0: Status 404 returned error can't find the container with id 4f5f8e6d3e660900fe01c452db9a20dfebe90aef5d2ca3eb900bfbc590880ee0
Jul 20 18:30:54.169574 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:54.169540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:54.271208 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:54.271177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:54.713360 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:54.713326    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8" event={"ID":"e51f7387-3743-46cf-9eb0-1bd994367927","Type":"ContainerStarted","Data":"1f811fc239e38d502d7a86a0e8ca18207b1fa12b45e25a7be4eba09cc3185ff5"}
Jul 20 18:30:54.713787 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:54.713381    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8" event={"ID":"e51f7387-3743-46cf-9eb0-1bd994367927","Type":"ContainerStarted","Data":"4f5f8e6d3e660900fe01c452db9a20dfebe90aef5d2ca3eb900bfbc590880ee0"}
Jul 20 18:30:54.732438 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:54.732375    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8" podStartSLOduration=1.732358594 podStartE2EDuration="1.732358594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:30:54.729603695 +0000 UTC m=+2562.101196953" watchObservedRunningTime="2026-07-20 18:30:54.732358594 +0000 UTC m=+2562.103951853"
Jul 20 18:30:55.720047 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:55.720013    2562 generic.go:356] "Generic (PLEG): container finished" podID="e51f7387-3743-46cf-9eb0-1bd994367927" containerID="1f811fc239e38d502d7a86a0e8ca18207b1fa12b45e25a7be4eba09cc3185ff5" exitCode=0
Jul 20 18:30:55.720467 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:55.720100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8" event={"ID":"e51f7387-3743-46cf-9eb0-1bd994367927","Type":"ContainerDied","Data":"1f811fc239e38d502d7a86a0e8ca18207b1fa12b45e25a7be4eba09cc3185ff5"}
Jul 20 18:30:56.451991 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:56.451964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:30:56.860573 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:56.860553    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"
Jul 20 18:30:56.932329 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:56.932295    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e51f7387-3743-46cf-9eb0-1bd994367927-maas-api-service-ca\") pod \"e51f7387-3743-46cf-9eb0-1bd994367927\" (UID: \"e51f7387-3743-46cf-9eb0-1bd994367927\") "
Jul 20 18:30:56.932715 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:56.932693    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e51f7387-3743-46cf-9eb0-1bd994367927-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e51f7387-3743-46cf-9eb0-1bd994367927" (UID: "e51f7387-3743-46cf-9eb0-1bd994367927"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:30:57.033532 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:57.033452    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e51f7387-3743-46cf-9eb0-1bd994367927-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:30:57.732280 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:57.732251    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"
Jul 20 18:30:57.732486 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:57.732256    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8" event={"ID":"e51f7387-3743-46cf-9eb0-1bd994367927","Type":"ContainerDied","Data":"4f5f8e6d3e660900fe01c452db9a20dfebe90aef5d2ca3eb900bfbc590880ee0"}
Jul 20 18:30:57.732486 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:30:57.732369    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f5f8e6d3e660900fe01c452db9a20dfebe90aef5d2ca3eb900bfbc590880ee0"
Jul 20 18:31:04.078821 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.078790    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"]
Jul 20 18:31:04.079413 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.078980    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k" podUID="a161682d-f334-4940-aa9c-b62f36ae6d49" containerName="maas-api" containerID="cri-o://621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5" gracePeriod=30
Jul 20 18:31:04.118854 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.118811    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4"]
Jul 20 18:31:04.124172 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.124144    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-e73607-29742870-j5sc4"]
Jul 20 18:31:04.150325 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.150286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:04.332947 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.332887    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:31:04.402619 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.402587    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a161682d-f334-4940-aa9c-b62f36ae6d49-maas-api-tls\") pod \"a161682d-f334-4940-aa9c-b62f36ae6d49\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") "
Jul 20 18:31:04.402768 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.402625    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a161682d-f334-4940-aa9c-b62f36ae6d49-openshift-service-ca\") pod \"a161682d-f334-4940-aa9c-b62f36ae6d49\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") "
Jul 20 18:31:04.402768 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.402736    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rn6m\" (UniqueName: \"kubernetes.io/projected/a161682d-f334-4940-aa9c-b62f36ae6d49-kube-api-access-9rn6m\") pod \"a161682d-f334-4940-aa9c-b62f36ae6d49\" (UID: \"a161682d-f334-4940-aa9c-b62f36ae6d49\") "
Jul 20 18:31:04.403053 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.403024    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a161682d-f334-4940-aa9c-b62f36ae6d49-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a161682d-f334-4940-aa9c-b62f36ae6d49" (UID: "a161682d-f334-4940-aa9c-b62f36ae6d49"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:31:04.404870 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.404836    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a161682d-f334-4940-aa9c-b62f36ae6d49-kube-api-access-9rn6m" (OuterVolumeSpecName: "kube-api-access-9rn6m") pod "a161682d-f334-4940-aa9c-b62f36ae6d49" (UID: "a161682d-f334-4940-aa9c-b62f36ae6d49"). InnerVolumeSpecName "kube-api-access-9rn6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:31:04.404959 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.404911    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a161682d-f334-4940-aa9c-b62f36ae6d49-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a161682d-f334-4940-aa9c-b62f36ae6d49" (UID: "a161682d-f334-4940-aa9c-b62f36ae6d49"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:31:04.504511 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.504470    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a161682d-f334-4940-aa9c-b62f36ae6d49-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:31:04.504511 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.504501    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a161682d-f334-4940-aa9c-b62f36ae6d49-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:31:04.504511 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.504510    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rn6m\" (UniqueName: \"kubernetes.io/projected/a161682d-f334-4940-aa9c-b62f36ae6d49-kube-api-access-9rn6m\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:31:04.770715 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.770685    2562 generic.go:356] "Generic (PLEG): container finished" podID="a161682d-f334-4940-aa9c-b62f36ae6d49" containerID="621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5" exitCode=0
Jul 20 18:31:04.770902 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.770729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k" event={"ID":"a161682d-f334-4940-aa9c-b62f36ae6d49","Type":"ContainerDied","Data":"621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5"}
Jul 20 18:31:04.770902 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.770737    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"
Jul 20 18:31:04.770902 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.770796    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k" event={"ID":"a161682d-f334-4940-aa9c-b62f36ae6d49","Type":"ContainerDied","Data":"e18b20f3a41c80572b350b57bbc50e6ede3e002be653f309a10f6d81b3865c2d"}
Jul 20 18:31:04.770902 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.770819    2562 scope.go:117] "RemoveContainer" containerID="621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5"
Jul 20 18:31:04.783049 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.783023    2562 scope.go:117] "RemoveContainer" containerID="621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5"
Jul 20 18:31:04.783372 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:31:04.783347    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5\": container with ID starting with 621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5 not found: ID does not exist" containerID="621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5"
Jul 20 18:31:04.783505 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.783378    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5"} err="failed to get container status \"621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5\": rpc error: code = NotFound desc = could not find container \"621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5\": container with ID starting with 621d9a44f4875ce55880dc64f6dd871e096b95464e0e2643ab06f7bf78136bf5 not found: ID does not exist"
Jul 20 18:31:04.797941 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.797907    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"]
Jul 20 18:31:04.803832 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:04.803811    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e73607-6f968c8f88-44l6k"]
Jul 20 18:31:05.181058 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:05.180964    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e7d84e0-983c-4ac7-8ad1-a3fde1675df0" path="/var/lib/kubelet/pods/9e7d84e0-983c-4ac7-8ad1-a3fde1675df0/volumes"
Jul 20 18:31:05.181458 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:05.181340    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a161682d-f334-4940-aa9c-b62f36ae6d49" path="/var/lib/kubelet/pods/a161682d-f334-4940-aa9c-b62f36ae6d49/volumes"
Jul 20 18:31:08.567684 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:08.567649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:08.568769 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:08.568747    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"]
Jul 20 18:31:08.570531 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:08.570511    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e73607-jc5w8"]
Jul 20 18:31:08.998155 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:08.998123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:09.182060 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:09.182026    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e51f7387-3743-46cf-9eb0-1bd994367927" path="/var/lib/kubelet/pods/e51f7387-3743-46cf-9eb0-1bd994367927/volumes"
Jul 20 18:31:13.410519 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:13.410485    2562 scope.go:117] "RemoveContainer" containerID="74f784a48627858f6420f4483719559ff2f3c5c05a26443d3b101fba68a1555c"
Jul 20 18:31:14.944169 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:14.944115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:15.046132 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:15.046096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:15.241577 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:15.241497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:15.539559 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:15.539471    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:15.914508 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:15.914471    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:16.257804 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:16.257717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:16.924036 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:16.924000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:19.298979 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.298942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:19.417648 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.417608    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:19.606451 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.606412    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"]
Jul 20 18:31:19.606938 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.606921    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a161682d-f334-4940-aa9c-b62f36ae6d49" containerName="maas-api"
Jul 20 18:31:19.607004 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.606940    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a161682d-f334-4940-aa9c-b62f36ae6d49" containerName="maas-api"
Jul 20 18:31:19.607004 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.606965    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e51f7387-3743-46cf-9eb0-1bd994367927" containerName="revoke-keys"
Jul 20 18:31:19.607004 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.606971    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e51f7387-3743-46cf-9eb0-1bd994367927" containerName="revoke-keys"
Jul 20 18:31:19.607164 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.607032    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e51f7387-3743-46cf-9eb0-1bd994367927" containerName="revoke-keys"
Jul 20 18:31:19.607164 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.607040    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a161682d-f334-4940-aa9c-b62f36ae6d49" containerName="maas-api"
Jul 20 18:31:19.610071 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.610048    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:19.613210 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.613190    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-f9ae33-serving-cert\""
Jul 20 18:31:19.620832 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.620773    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"]
Jul 20 18:31:19.636614 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.636588    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:19.749059 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.749023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls\") pod \"maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:19.749255 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.749103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrqsj\" (UniqueName: \"kubernetes.io/projected/037099bb-9a4c-459d-a657-620325860c85-kube-api-access-zrqsj\") pod \"maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:19.749255 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.749194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/037099bb-9a4c-459d-a657-620325860c85-openshift-service-ca\") pod \"maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:19.850446 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.850415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/037099bb-9a4c-459d-a657-620325860c85-openshift-service-ca\") pod \"maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:19.850636 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.850487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls\") pod \"maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:19.850636 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.850563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrqsj\" (UniqueName: \"kubernetes.io/projected/037099bb-9a4c-459d-a657-620325860c85-kube-api-access-zrqsj\") pod \"maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:19.850636 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:31:19.850629    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-serving-cert: secret "maas-api-e2e-api-a-f9ae33-serving-cert" not found
Jul 20 18:31:19.850757 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:31:19.850703    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls podName:037099bb-9a4c-459d-a657-620325860c85 nodeName:}" failed. No retries permitted until 2026-07-20 18:31:20.350684783 +0000 UTC m=+2587.722278020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls") pod "maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j" (UID: "037099bb-9a4c-459d-a657-620325860c85") : secret "maas-api-e2e-api-a-f9ae33-serving-cert" not found
Jul 20 18:31:19.850993 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.850976    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/037099bb-9a4c-459d-a657-620325860c85-openshift-service-ca\") pod \"maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:19.863053 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:19.862989    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrqsj\" (UniqueName: \"kubernetes.io/projected/037099bb-9a4c-459d-a657-620325860c85-kube-api-access-zrqsj\") pod \"maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:20.152122 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:20.152022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:20.289177 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:20.289140    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:20.356583 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:20.356550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls\") pod \"maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:20.357066 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:31:20.356672    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-serving-cert: secret "maas-api-e2e-api-a-f9ae33-serving-cert" not found
Jul 20 18:31:20.357066 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:31:20.356733    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls podName:037099bb-9a4c-459d-a657-620325860c85 nodeName:}" failed. No retries permitted until 2026-07-20 18:31:21.356715361 +0000 UTC m=+2588.728308601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls") pod "maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j" (UID: "037099bb-9a4c-459d-a657-620325860c85") : secret "maas-api-e2e-api-a-f9ae33-serving-cert" not found
Jul 20 18:31:21.014037 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:21.014003    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:21.367505 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:21.367482    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls\") pod \"maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:21.369812 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:21.369796    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls\") pod \"maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:21.423986 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:21.423951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:21.572019 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:21.571991    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"]
Jul 20 18:31:21.574039 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:31:21.574013    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod037099bb_9a4c_459d_a657_620325860c85.slice/crio-7fbb4c61422db5a389c5660ad4efd9e3279474313505ee76acccf33952e35ce7 WatchSource:0}: Error finding container 7fbb4c61422db5a389c5660ad4efd9e3279474313505ee76acccf33952e35ce7: Status 404 returned error can't find the container with id 7fbb4c61422db5a389c5660ad4efd9e3279474313505ee76acccf33952e35ce7
Jul 20 18:31:21.575846 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:21.575825    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:31:21.860424 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:21.860377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j" event={"ID":"037099bb-9a4c-459d-a657-620325860c85","Type":"ContainerStarted","Data":"7fbb4c61422db5a389c5660ad4efd9e3279474313505ee76acccf33952e35ce7"}
Jul 20 18:31:22.867107 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:22.867070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j" event={"ID":"037099bb-9a4c-459d-a657-620325860c85","Type":"ContainerStarted","Data":"c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28"}
Jul 20 18:31:22.867525 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:22.867177    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:22.885789 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:22.885739    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j" podStartSLOduration=3.422201462 podStartE2EDuration="3.885725723s" totalImagesPullingTime="463.524261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:31:22.884314938 +0000 UTC m=+2590.255908199" watchObservedRunningTime="2026-07-20 18:31:22.885725723 +0000 UTC m=+2590.257319023"
Jul 20 18:31:23.780602 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:23.780566    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:24.303134 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:24.303102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:24.904111 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:24.904076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:25.008204 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:25.008168    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:28.245578 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.245539    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:28.350188 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.350152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:28.490269 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.490237    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"]
Jul 20 18:31:28.494533 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.494510    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:28.498487 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.498428    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9c6cfa-serving-cert\""
Jul 20 18:31:28.508968 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.508943    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"]
Jul 20 18:31:28.538280 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.538243    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446abecb-ce5e-4503-9175-f07cf477d4ec-openshift-service-ca\") pod \"maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:28.538469 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.538301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdvdq\" (UniqueName: \"kubernetes.io/projected/446abecb-ce5e-4503-9175-f07cf477d4ec-kube-api-access-zdvdq\") pod \"maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:28.538551 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.538469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446abecb-ce5e-4503-9175-f07cf477d4ec-maas-api-tls\") pod \"maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:28.538999 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.538983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:28.639317 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.639283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446abecb-ce5e-4503-9175-f07cf477d4ec-maas-api-tls\") pod \"maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:28.639514 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.639351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446abecb-ce5e-4503-9175-f07cf477d4ec-openshift-service-ca\") pod \"maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:28.639514 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.639437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdvdq\" (UniqueName: \"kubernetes.io/projected/446abecb-ce5e-4503-9175-f07cf477d4ec-kube-api-access-zdvdq\") pod \"maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:28.639514 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:31:28.639492    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-serving-cert: secret "maas-api-e2e-api-b-9c6cfa-serving-cert" not found
Jul 20 18:31:28.639672 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:31:28.639568    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/446abecb-ce5e-4503-9175-f07cf477d4ec-maas-api-tls podName:446abecb-ce5e-4503-9175-f07cf477d4ec nodeName:}" failed. No retries permitted until 2026-07-20 18:31:29.139546732 +0000 UTC m=+2596.511139974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/446abecb-ce5e-4503-9175-f07cf477d4ec-maas-api-tls") pod "maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8" (UID: "446abecb-ce5e-4503-9175-f07cf477d4ec") : secret "maas-api-e2e-api-b-9c6cfa-serving-cert" not found
Jul 20 18:31:28.639960 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.639941    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446abecb-ce5e-4503-9175-f07cf477d4ec-openshift-service-ca\") pod \"maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:28.673074 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.673038    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdvdq\" (UniqueName: \"kubernetes.io/projected/446abecb-ce5e-4503-9175-f07cf477d4ec-kube-api-access-zdvdq\") pod \"maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:28.878738 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:28.878713    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:29.030762 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:29.030730    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:29.136862 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:29.136782    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:29.145139 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:29.145121    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446abecb-ce5e-4503-9175-f07cf477d4ec-maas-api-tls\") pod \"maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:29.147848 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:29.147824    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446abecb-ce5e-4503-9175-f07cf477d4ec-maas-api-tls\") pod \"maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:29.241823 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:29.241789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:29.407535 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:29.407448    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:29.551418 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:29.551375    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"]
Jul 20 18:31:29.553255 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:31:29.553231    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446abecb_ce5e_4503_9175_f07cf477d4ec.slice/crio-19a417675487ca48b135ea601cc50331c240afe71ae3ae0a11bfe9e73928aa09 WatchSource:0}: Error finding container 19a417675487ca48b135ea601cc50331c240afe71ae3ae0a11bfe9e73928aa09: Status 404 returned error can't find the container with id 19a417675487ca48b135ea601cc50331c240afe71ae3ae0a11bfe9e73928aa09
Jul 20 18:31:29.906865 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:29.906832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8" event={"ID":"446abecb-ce5e-4503-9175-f07cf477d4ec","Type":"ContainerStarted","Data":"19a417675487ca48b135ea601cc50331c240afe71ae3ae0a11bfe9e73928aa09"}
Jul 20 18:31:30.913825 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:30.913784    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8" event={"ID":"446abecb-ce5e-4503-9175-f07cf477d4ec","Type":"ContainerStarted","Data":"f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f"}
Jul 20 18:31:30.914208 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:30.913942    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:30.933954 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:30.933910    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8" podStartSLOduration=2.5173105099999997 podStartE2EDuration="2.933895559s" totalImagesPullingTime="416.585049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:31:30.93133572 +0000 UTC m=+2598.302928992" watchObservedRunningTime="2026-07-20 18:31:30.933895559 +0000 UTC m=+2598.305488817"
Jul 20 18:31:32.806875 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:32.806839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:36.924633 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:36.924564    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:31:41.068859 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.068829    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"]
Jul 20 18:31:41.073977 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.073960    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"
Jul 20 18:31:41.076762 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.076746    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:31:41.083975 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.083951    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"]
Jul 20 18:31:41.104874 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.104833    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:41.157873 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.157839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a18066ca-2c36-4e13-88c6-325b2fc8563f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv\" (UID: \"a18066ca-2c36-4e13-88c6-325b2fc8563f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"
Jul 20 18:31:41.207430 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.207387    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:41.258628 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.258602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a18066ca-2c36-4e13-88c6-325b2fc8563f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv\" (UID: \"a18066ca-2c36-4e13-88c6-325b2fc8563f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"
Jul 20 18:31:41.259264 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.259243    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a18066ca-2c36-4e13-88c6-325b2fc8563f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv\" (UID: \"a18066ca-2c36-4e13-88c6-325b2fc8563f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"
Jul 20 18:31:41.385833 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.385799    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"
Jul 20 18:31:41.534571 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.534538    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"]
Jul 20 18:31:41.537062 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:31:41.537035    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18066ca_2c36_4e13_88c6_325b2fc8563f.slice/crio-477aad6a40872a1de7051574adc1bd5735484096acc0a81bf4148da98ef69637 WatchSource:0}: Error finding container 477aad6a40872a1de7051574adc1bd5735484096acc0a81bf4148da98ef69637: Status 404 returned error can't find the container with id 477aad6a40872a1de7051574adc1bd5735484096acc0a81bf4148da98ef69637
Jul 20 18:31:41.973207 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.973128    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv" event={"ID":"a18066ca-2c36-4e13-88c6-325b2fc8563f","Type":"ContainerStarted","Data":"263ce1e586007fcb7a21321a21c404b570ca90f0054cca08b556bb8ddba4a87e"}
Jul 20 18:31:41.973207 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.973177    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv" event={"ID":"a18066ca-2c36-4e13-88c6-325b2fc8563f","Type":"ContainerStarted","Data":"477aad6a40872a1de7051574adc1bd5735484096acc0a81bf4148da98ef69637"}
Jul 20 18:31:41.991582 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:41.991523    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv" podStartSLOduration=0.991506562 podStartE2EDuration="991.506562ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:31:41.989689751 +0000 UTC m=+2609.361283014" watchObservedRunningTime="2026-07-20 18:31:41.991506562 +0000 UTC m=+2609.363099820"
Jul 20 18:31:42.979968 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:42.979928    2562 generic.go:356] "Generic (PLEG): container finished" podID="a18066ca-2c36-4e13-88c6-325b2fc8563f" containerID="263ce1e586007fcb7a21321a21c404b570ca90f0054cca08b556bb8ddba4a87e" exitCode=0
Jul 20 18:31:42.980370 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:42.979982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv" event={"ID":"a18066ca-2c36-4e13-88c6-325b2fc8563f","Type":"ContainerDied","Data":"263ce1e586007fcb7a21321a21c404b570ca90f0054cca08b556bb8ddba4a87e"}
Jul 20 18:31:44.125737 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:44.125709    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"
Jul 20 18:31:44.187312 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:44.187280    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a18066ca-2c36-4e13-88c6-325b2fc8563f-maas-api-service-ca\") pod \"a18066ca-2c36-4e13-88c6-325b2fc8563f\" (UID: \"a18066ca-2c36-4e13-88c6-325b2fc8563f\") "
Jul 20 18:31:44.187683 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:44.187659    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a18066ca-2c36-4e13-88c6-325b2fc8563f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a18066ca-2c36-4e13-88c6-325b2fc8563f" (UID: "a18066ca-2c36-4e13-88c6-325b2fc8563f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:31:44.288332 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:44.288256    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a18066ca-2c36-4e13-88c6-325b2fc8563f-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:31:44.993203 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:44.993173    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"
Jul 20 18:31:44.993382 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:44.993201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv" event={"ID":"a18066ca-2c36-4e13-88c6-325b2fc8563f","Type":"ContainerDied","Data":"477aad6a40872a1de7051574adc1bd5735484096acc0a81bf4148da98ef69637"}
Jul 20 18:31:44.993382 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:44.993252    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="477aad6a40872a1de7051574adc1bd5735484096acc0a81bf4148da98ef69637"
Jul 20 18:31:51.010341 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:51.010270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:51.107985 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:51.107954    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:56.254890 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.254854    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"]
Jul 20 18:31:56.255412 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.255147    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j" podUID="037099bb-9a4c-459d-a657-620325860c85" containerName="maas-api" containerID="cri-o://c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28" gracePeriod=30
Jul 20 18:31:56.282124 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.282098    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:31:56.516582 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.516521    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:56.613981 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.613941    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls\") pod \"037099bb-9a4c-459d-a657-620325860c85\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") "
Jul 20 18:31:56.614167 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.614064    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrqsj\" (UniqueName: \"kubernetes.io/projected/037099bb-9a4c-459d-a657-620325860c85-kube-api-access-zrqsj\") pod \"037099bb-9a4c-459d-a657-620325860c85\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") "
Jul 20 18:31:56.614167 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.614124    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/037099bb-9a4c-459d-a657-620325860c85-openshift-service-ca\") pod \"037099bb-9a4c-459d-a657-620325860c85\" (UID: \"037099bb-9a4c-459d-a657-620325860c85\") "
Jul 20 18:31:56.614563 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.614538    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/037099bb-9a4c-459d-a657-620325860c85-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "037099bb-9a4c-459d-a657-620325860c85" (UID: "037099bb-9a4c-459d-a657-620325860c85"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:31:56.616186 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.616161    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "037099bb-9a4c-459d-a657-620325860c85" (UID: "037099bb-9a4c-459d-a657-620325860c85"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:31:56.616286 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.616239    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037099bb-9a4c-459d-a657-620325860c85-kube-api-access-zrqsj" (OuterVolumeSpecName: "kube-api-access-zrqsj") pod "037099bb-9a4c-459d-a657-620325860c85" (UID: "037099bb-9a4c-459d-a657-620325860c85"). InnerVolumeSpecName "kube-api-access-zrqsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:31:56.715141 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.715104    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/037099bb-9a4c-459d-a657-620325860c85-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:31:56.715141 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.715137    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/037099bb-9a4c-459d-a657-620325860c85-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:31:56.715141 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:56.715146    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrqsj\" (UniqueName: \"kubernetes.io/projected/037099bb-9a4c-459d-a657-620325860c85-kube-api-access-zrqsj\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:31:57.065459 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:57.065420    2562 generic.go:356] "Generic (PLEG): container finished" podID="037099bb-9a4c-459d-a657-620325860c85" containerID="c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28" exitCode=0
Jul 20 18:31:57.065459 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:57.065465    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"
Jul 20 18:31:57.065689 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:57.065476    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j" event={"ID":"037099bb-9a4c-459d-a657-620325860c85","Type":"ContainerDied","Data":"c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28"}
Jul 20 18:31:57.065689 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:57.065534    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j" event={"ID":"037099bb-9a4c-459d-a657-620325860c85","Type":"ContainerDied","Data":"7fbb4c61422db5a389c5660ad4efd9e3279474313505ee76acccf33952e35ce7"}
Jul 20 18:31:57.065689 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:57.065555    2562 scope.go:117] "RemoveContainer" containerID="c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28"
Jul 20 18:31:57.075269 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:57.075252    2562 scope.go:117] "RemoveContainer" containerID="c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28"
Jul 20 18:31:57.075548 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:31:57.075527    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28\": container with ID starting with c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28 not found: ID does not exist" containerID="c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28"
Jul 20 18:31:57.075601 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:57.075559    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28"} err="failed to get container status \"c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28\": rpc error: code = NotFound desc = could not find container \"c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28\": container with ID starting with c39e838f5722ab934d11f0e4161230aff52f5266cdafdbe3d714fae6f36bbd28 not found: ID does not exist"
Jul 20 18:31:57.088057 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:57.088031    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"]
Jul 20 18:31:57.091578 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:57.091556    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f9ae33-648f474b79-zfs9j"]
Jul 20 18:31:57.180722 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:31:57.180695    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="037099bb-9a4c-459d-a657-620325860c85" path="/var/lib/kubelet/pods/037099bb-9a4c-459d-a657-620325860c85/volumes"
Jul 20 18:32:01.145957 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:01.145922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:01.146812 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:01.146580    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"]
Jul 20 18:32:01.148959 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:01.148939    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f9ae33-l2xzv"]
Jul 20 18:32:01.180021 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:01.179992    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18066ca-2c36-4e13-88c6-325b2fc8563f" path="/var/lib/kubelet/pods/a18066ca-2c36-4e13-88c6-325b2fc8563f/volumes"
Jul 20 18:32:01.545160 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:01.545063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:07.696205 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:07.696174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:08.031306 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.031218    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"]
Jul 20 18:32:08.031664 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.031651    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037099bb-9a4c-459d-a657-620325860c85" containerName="maas-api"
Jul 20 18:32:08.031728 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.031667    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="037099bb-9a4c-459d-a657-620325860c85" containerName="maas-api"
Jul 20 18:32:08.031728 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.031679    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18066ca-2c36-4e13-88c6-325b2fc8563f" containerName="revoke-keys"
Jul 20 18:32:08.031728 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.031684    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18066ca-2c36-4e13-88c6-325b2fc8563f" containerName="revoke-keys"
Jul 20 18:32:08.031825 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.031746    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18066ca-2c36-4e13-88c6-325b2fc8563f" containerName="revoke-keys"
Jul 20 18:32:08.031825 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.031754    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="037099bb-9a4c-459d-a657-620325860c85" containerName="maas-api"
Jul 20 18:32:08.036122 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.036102    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"
Jul 20 18:32:08.039374 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.039357    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:32:08.045308 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.045286    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"]
Jul 20 18:32:08.102948 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.102913    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:08.131503 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.131472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6363d3d0-3183-4c9d-80e9-ce2344afcfa7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5\" (UID: \"6363d3d0-3183-4c9d-80e9-ce2344afcfa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"
Jul 20 18:32:08.185616 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.185586    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:08.232659 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.232627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6363d3d0-3183-4c9d-80e9-ce2344afcfa7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5\" (UID: \"6363d3d0-3183-4c9d-80e9-ce2344afcfa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"
Jul 20 18:32:08.233215 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.233196    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6363d3d0-3183-4c9d-80e9-ce2344afcfa7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5\" (UID: \"6363d3d0-3183-4c9d-80e9-ce2344afcfa7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"
Jul 20 18:32:08.347690 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.347645    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"
Jul 20 18:32:08.485351 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:08.485320    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"]
Jul 20 18:32:08.486459 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:32:08.486431    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6363d3d0_3183_4c9d_80e9_ce2344afcfa7.slice/crio-d235d1c137e64497cf9b00ec673eb60493f422ced01335cdc995f03cb9f5ec3c WatchSource:0}: Error finding container d235d1c137e64497cf9b00ec673eb60493f422ced01335cdc995f03cb9f5ec3c: Status 404 returned error can't find the container with id d235d1c137e64497cf9b00ec673eb60493f422ced01335cdc995f03cb9f5ec3c
Jul 20 18:32:09.134191 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:09.134158    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5" event={"ID":"6363d3d0-3183-4c9d-80e9-ce2344afcfa7","Type":"ContainerStarted","Data":"fe67daaa180943314d96d934fcb5a9f365fc0dd8d0251eb35b91dbb442f34361"}
Jul 20 18:32:09.134585 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:09.134211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5" event={"ID":"6363d3d0-3183-4c9d-80e9-ce2344afcfa7","Type":"ContainerStarted","Data":"d235d1c137e64497cf9b00ec673eb60493f422ced01335cdc995f03cb9f5ec3c"}
Jul 20 18:32:09.160793 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:09.160740    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5" podStartSLOduration=1.160725761 podStartE2EDuration="1.160725761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:32:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:32:09.159725941 +0000 UTC m=+2636.531319210" watchObservedRunningTime="2026-07-20 18:32:09.160725761 +0000 UTC m=+2636.532319020"
Jul 20 18:32:10.141027 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:10.140992    2562 generic.go:356] "Generic (PLEG): container finished" podID="6363d3d0-3183-4c9d-80e9-ce2344afcfa7" containerID="fe67daaa180943314d96d934fcb5a9f365fc0dd8d0251eb35b91dbb442f34361" exitCode=0
Jul 20 18:32:10.141027 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:10.141031    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5" event={"ID":"6363d3d0-3183-4c9d-80e9-ce2344afcfa7","Type":"ContainerDied","Data":"fe67daaa180943314d96d934fcb5a9f365fc0dd8d0251eb35b91dbb442f34361"}
Jul 20 18:32:11.287314 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:11.287287    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"
Jul 20 18:32:11.366896 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:11.366862    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6363d3d0-3183-4c9d-80e9-ce2344afcfa7-maas-api-service-ca\") pod \"6363d3d0-3183-4c9d-80e9-ce2344afcfa7\" (UID: \"6363d3d0-3183-4c9d-80e9-ce2344afcfa7\") "
Jul 20 18:32:11.367251 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:11.367223    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6363d3d0-3183-4c9d-80e9-ce2344afcfa7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6363d3d0-3183-4c9d-80e9-ce2344afcfa7" (UID: "6363d3d0-3183-4c9d-80e9-ce2344afcfa7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:32:11.467987 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:11.467910    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6363d3d0-3183-4c9d-80e9-ce2344afcfa7-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:32:12.152831 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:12.152798    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5" event={"ID":"6363d3d0-3183-4c9d-80e9-ce2344afcfa7","Type":"ContainerDied","Data":"d235d1c137e64497cf9b00ec673eb60493f422ced01335cdc995f03cb9f5ec3c"}
Jul 20 18:32:12.152831 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:12.152815    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"
Jul 20 18:32:12.153044 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:12.152843    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d235d1c137e64497cf9b00ec673eb60493f422ced01335cdc995f03cb9f5ec3c"
Jul 20 18:32:23.681685 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:23.681641    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"]
Jul 20 18:32:23.682133 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:23.681941    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8" podUID="446abecb-ce5e-4503-9175-f07cf477d4ec" containerName="maas-api" containerID="cri-o://f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f" gracePeriod=30
Jul 20 18:32:23.722088 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:23.722056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:23.938858 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:23.938791    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:32:24.098081 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.098044    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdvdq\" (UniqueName: \"kubernetes.io/projected/446abecb-ce5e-4503-9175-f07cf477d4ec-kube-api-access-zdvdq\") pod \"446abecb-ce5e-4503-9175-f07cf477d4ec\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") "
Jul 20 18:32:24.098293 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.098121    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446abecb-ce5e-4503-9175-f07cf477d4ec-maas-api-tls\") pod \"446abecb-ce5e-4503-9175-f07cf477d4ec\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") "
Jul 20 18:32:24.098293 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.098195    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446abecb-ce5e-4503-9175-f07cf477d4ec-openshift-service-ca\") pod \"446abecb-ce5e-4503-9175-f07cf477d4ec\" (UID: \"446abecb-ce5e-4503-9175-f07cf477d4ec\") "
Jul 20 18:32:24.098627 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.098600    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/446abecb-ce5e-4503-9175-f07cf477d4ec-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "446abecb-ce5e-4503-9175-f07cf477d4ec" (UID: "446abecb-ce5e-4503-9175-f07cf477d4ec"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:32:24.100441 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.100417    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/446abecb-ce5e-4503-9175-f07cf477d4ec-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "446abecb-ce5e-4503-9175-f07cf477d4ec" (UID: "446abecb-ce5e-4503-9175-f07cf477d4ec"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:32:24.100507 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.100444    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/446abecb-ce5e-4503-9175-f07cf477d4ec-kube-api-access-zdvdq" (OuterVolumeSpecName: "kube-api-access-zdvdq") pod "446abecb-ce5e-4503-9175-f07cf477d4ec" (UID: "446abecb-ce5e-4503-9175-f07cf477d4ec"). InnerVolumeSpecName "kube-api-access-zdvdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:32:24.199530 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.199458    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446abecb-ce5e-4503-9175-f07cf477d4ec-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:32:24.199530 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.199481    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446abecb-ce5e-4503-9175-f07cf477d4ec-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:32:24.199530 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.199491    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdvdq\" (UniqueName: \"kubernetes.io/projected/446abecb-ce5e-4503-9175-f07cf477d4ec-kube-api-access-zdvdq\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:32:24.219184 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.219151    2562 generic.go:356] "Generic (PLEG): container finished" podID="446abecb-ce5e-4503-9175-f07cf477d4ec" containerID="f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f" exitCode=0
Jul 20 18:32:24.219333 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.219195    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"
Jul 20 18:32:24.219333 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.219235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8" event={"ID":"446abecb-ce5e-4503-9175-f07cf477d4ec","Type":"ContainerDied","Data":"f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f"}
Jul 20 18:32:24.219333 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.219290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8" event={"ID":"446abecb-ce5e-4503-9175-f07cf477d4ec","Type":"ContainerDied","Data":"19a417675487ca48b135ea601cc50331c240afe71ae3ae0a11bfe9e73928aa09"}
Jul 20 18:32:24.219333 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.219311    2562 scope.go:117] "RemoveContainer" containerID="f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f"
Jul 20 18:32:24.228638 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.228622    2562 scope.go:117] "RemoveContainer" containerID="f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f"
Jul 20 18:32:24.228917 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:32:24.228898    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f\": container with ID starting with f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f not found: ID does not exist" containerID="f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f"
Jul 20 18:32:24.228957 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.228926    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f"} err="failed to get container status \"f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f\": rpc error: code = NotFound desc = could not find container \"f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f\": container with ID starting with f22ecadd917373e39b774a9e78d7a41aee3f85e329a77e664a7f8dd1d177098f not found: ID does not exist"
Jul 20 18:32:24.241229 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.241205    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"]
Jul 20 18:32:24.245458 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:24.245438    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c6cfa-6b5b95bcc9-tp6z8"]
Jul 20 18:32:25.180261 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:25.180227    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="446abecb-ce5e-4503-9175-f07cf477d4ec" path="/var/lib/kubelet/pods/446abecb-ce5e-4503-9175-f07cf477d4ec/volumes"
Jul 20 18:32:28.114047 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:28.114008    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:28.118759 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:28.118724    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"]
Jul 20 18:32:28.124968 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:28.124934    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9c6cfa-7pdz5"]
Jul 20 18:32:28.526668 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:28.526583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:29.180402 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:29.180367    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6363d3d0-3183-4c9d-80e9-ce2344afcfa7" path="/var/lib/kubelet/pods/6363d3d0-3183-4c9d-80e9-ce2344afcfa7/volumes"
Jul 20 18:32:34.746197 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:34.746131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:34.846648 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:34.846618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:35.054073 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:35.053990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:35.271161 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:35.271123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:35.705836 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:35.705803    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:36.029720 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:36.029623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:36.299610 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:36.299516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:38.834240 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.834211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:38.906445 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.906376    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"]
Jul 20 18:32:38.906874 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.906858    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6363d3d0-3183-4c9d-80e9-ce2344afcfa7" containerName="revoke-keys"
Jul 20 18:32:38.906874 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.906875    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6363d3d0-3183-4c9d-80e9-ce2344afcfa7" containerName="revoke-keys"
Jul 20 18:32:38.907018 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.906887    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="446abecb-ce5e-4503-9175-f07cf477d4ec" containerName="maas-api"
Jul 20 18:32:38.907018 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.906896    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="446abecb-ce5e-4503-9175-f07cf477d4ec" containerName="maas-api"
Jul 20 18:32:38.907018 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.906992    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="446abecb-ce5e-4503-9175-f07cf477d4ec" containerName="maas-api"
Jul 20 18:32:38.907018 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.907001    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6363d3d0-3183-4c9d-80e9-ce2344afcfa7" containerName="revoke-keys"
Jul 20 18:32:38.911622 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.911603    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:38.914483 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.914454    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-daa21b-serving-cert\""
Jul 20 18:32:38.923004 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.922979    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"]
Jul 20 18:32:38.943240 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.943201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e476b1-5da1-4c36-a469-290a3c8b0d03-openshift-service-ca\") pod \"maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:38.943415 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.943292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cccz\" (UniqueName: \"kubernetes.io/projected/03e476b1-5da1-4c36-a469-290a3c8b0d03-kube-api-access-7cccz\") pod \"maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:38.943415 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.943328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e476b1-5da1-4c36-a469-290a3c8b0d03-maas-api-tls\") pod \"maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:38.954896 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:38.954872    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:39.044065 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:39.044028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e476b1-5da1-4c36-a469-290a3c8b0d03-openshift-service-ca\") pod \"maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:39.044248 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:39.044115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cccz\" (UniqueName: \"kubernetes.io/projected/03e476b1-5da1-4c36-a469-290a3c8b0d03-kube-api-access-7cccz\") pod \"maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:39.044248 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:39.044150    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e476b1-5da1-4c36-a469-290a3c8b0d03-maas-api-tls\") pod \"maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:39.044338 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:32:39.044269    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-serving-cert: secret "maas-api-e2e-shared-a-daa21b-serving-cert" not found
Jul 20 18:32:39.044338 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:32:39.044335    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e476b1-5da1-4c36-a469-290a3c8b0d03-maas-api-tls podName:03e476b1-5da1-4c36-a469-290a3c8b0d03 nodeName:}" failed. No retries permitted until 2026-07-20 18:32:39.54431899 +0000 UTC m=+2666.915912227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/03e476b1-5da1-4c36-a469-290a3c8b0d03-maas-api-tls") pod "maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp" (UID: "03e476b1-5da1-4c36-a469-290a3c8b0d03") : secret "maas-api-e2e-shared-a-daa21b-serving-cert" not found
Jul 20 18:32:39.044690 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:39.044670    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e476b1-5da1-4c36-a469-290a3c8b0d03-openshift-service-ca\") pod \"maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:39.047067 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:39.047045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:39.054621 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:39.054600    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cccz\" (UniqueName: \"kubernetes.io/projected/03e476b1-5da1-4c36-a469-290a3c8b0d03-kube-api-access-7cccz\") pod \"maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:39.508084 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:39.508052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:39.549288 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:39.549257    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e476b1-5da1-4c36-a469-290a3c8b0d03-maas-api-tls\") pod \"maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:39.551827 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:39.551798    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e476b1-5da1-4c36-a469-290a3c8b0d03-maas-api-tls\") pod \"maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:39.823833 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:39.823747    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:39.888264 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:39.887700    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:40.005850 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:40.005823    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"]
Jul 20 18:32:40.008936 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:32:40.008905    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e476b1_5da1_4c36_a469_290a3c8b0d03.slice/crio-a4d9a06874834ededad426be7cd1bb7048d603ed049b884506cb18c23c1c7ea8 WatchSource:0}: Error finding container a4d9a06874834ededad426be7cd1bb7048d603ed049b884506cb18c23c1c7ea8: Status 404 returned error can't find the container with id a4d9a06874834ededad426be7cd1bb7048d603ed049b884506cb18c23c1c7ea8
Jul 20 18:32:40.156251 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:40.156221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:40.305646 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:40.305608    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp" event={"ID":"03e476b1-5da1-4c36-a469-290a3c8b0d03","Type":"ContainerStarted","Data":"a4d9a06874834ededad426be7cd1bb7048d603ed049b884506cb18c23c1c7ea8"}
Jul 20 18:32:41.312835 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:41.312793    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp" event={"ID":"03e476b1-5da1-4c36-a469-290a3c8b0d03","Type":"ContainerStarted","Data":"ff65c3a613fd5a9cc32763b87f3f5481d8ee9945ab4b4d07dc3abf3697b35b66"}
Jul 20 18:32:41.313272 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:41.312940    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:41.332910 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:41.332853    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp" podStartSLOduration=2.9160866 podStartE2EDuration="3.33283538s" totalImagesPullingTime="416.74878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:32:41.331707585 +0000 UTC m=+2668.703300846" watchObservedRunningTime="2026-07-20 18:32:41.33283538 +0000 UTC m=+2668.704428639"
Jul 20 18:32:43.327976 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:43.327946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:43.669053 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:43.669019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:44.131031 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:44.130998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:44.619723 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:44.619692    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:46.733994 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:46.733960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:46.849317 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:46.849284    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"]
Jul 20 18:32:46.852939 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:46.852915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:46.855779 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:46.855759    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-d56278-serving-cert\""
Jul 20 18:32:46.866190 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:46.866109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:46.886802 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:46.886766    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"]
Jul 20 18:32:46.924944 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:46.924910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9mvq\" (UniqueName: \"kubernetes.io/projected/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-kube-api-access-c9mvq\") pod \"maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:46.925098 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:46.924949    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:46.925098 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:46.925067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-maas-api-tls\") pod \"maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:47.025655 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.025558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9mvq\" (UniqueName: \"kubernetes.io/projected/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-kube-api-access-c9mvq\") pod \"maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:47.025655 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.025598    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:47.025655 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.025649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-maas-api-tls\") pod \"maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:47.025967 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:32:47.025770    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-serving-cert: secret "maas-api-e2e-shared-b-d56278-serving-cert" not found
Jul 20 18:32:47.025967 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:32:47.025820    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-maas-api-tls podName:b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9 nodeName:}" failed. No retries permitted until 2026-07-20 18:32:47.525801818 +0000 UTC m=+2674.897395055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-maas-api-tls") pod "maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb" (UID: "b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9") : secret "maas-api-e2e-shared-b-d56278-serving-cert" not found
Jul 20 18:32:47.026301 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.026275    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:47.067159 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.067125    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9mvq\" (UniqueName: \"kubernetes.io/projected/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-kube-api-access-c9mvq\") pod \"maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:47.103184 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.103145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:47.289855 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.289762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:47.324793 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.324767    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:32:47.531454 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.531421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-maas-api-tls\") pod \"maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:47.534143 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.534119    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-maas-api-tls\") pod \"maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:47.710051 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.710004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:47.764228 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.764198    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:47.811117 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.811079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:47.905832 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:47.905809    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"]
Jul 20 18:32:47.908077 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:32:47.908042    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28a0eea_655c_4e83_83e0_a9cbc0c2c5b9.slice/crio-ea2fc37fb80553b0bd6254f5e36504938ec8f0caccf060b20a9b281116cfe172 WatchSource:0}: Error finding container ea2fc37fb80553b0bd6254f5e36504938ec8f0caccf060b20a9b281116cfe172: Status 404 returned error can't find the container with id ea2fc37fb80553b0bd6254f5e36504938ec8f0caccf060b20a9b281116cfe172
Jul 20 18:32:48.353505 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:48.353481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb" event={"ID":"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9","Type":"ContainerStarted","Data":"ea2fc37fb80553b0bd6254f5e36504938ec8f0caccf060b20a9b281116cfe172"}
Jul 20 18:32:49.359802 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:49.359759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb" event={"ID":"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9","Type":"ContainerStarted","Data":"33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc"}
Jul 20 18:32:49.360174 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:49.359938    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:32:49.381531 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:49.381487    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb" podStartSLOduration=2.99769997 podStartE2EDuration="3.381472513s" totalImagesPullingTime="383.772543ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:32:49.379180512 +0000 UTC m=+2676.750773770" watchObservedRunningTime="2026-07-20 18:32:49.381472513 +0000 UTC m=+2676.753065771"
Jul 20 18:32:51.182087 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:51.182057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:32:55.372071 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:32:55.372043    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:33:02.052983 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:02.052950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:02.152609 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:02.152579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:02.296112 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:02.296080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:03.348594 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:03.348561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:03.428683 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:03.428642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:03.520644 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:03.520610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:08.521724 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:08.521684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:08.622053 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:08.622018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:13.294506 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:13.294474    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:33:13.300004 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:13.299985    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:33:13.453043 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:13.453010    2562 scope.go:117] "RemoveContainer" containerID="3a6839879a8eda512f1e3f3b925513b368e35bce6546641cf7100a20a946e5e1"
Jul 20 18:33:42.828105 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:42.828069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:51.515624 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:51.515590    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:51.581898 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:51.581861    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:59.110753 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:59.110718    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:33:59.168091 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:33:59.168055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:34:15.461943 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:34:15.461913    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:34:24.878113 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:34:24.878080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:06.293094 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:35:06.293006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:46.546321 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:35:46.546285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:48.369089 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:35:48.369057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:35:49.751112 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:35:49.751077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:36:13.496816 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:36:13.496743    2562 scope.go:117] "RemoveContainer" containerID="4f62e3b31af601dd4dcef035f6c046d4a1cb714fd1aa930050817a99a5d3e8ef"
Jul 20 18:36:13.505476 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:36:13.505454    2562 scope.go:117] "RemoveContainer" containerID="a65113ceaf525bd2c240d726caf09e29d31e5ac67fb9f4b4d8c80ccf0ad68d15"
Jul 20 18:36:20.615205 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:36:20.615115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:07.363405 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:37:07.363369    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:08.287857 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:37:08.287824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:13.529468 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:37:13.529440    2562 scope.go:117] "RemoveContainer" containerID="1f811fc239e38d502d7a86a0e8ca18207b1fa12b45e25a7be4eba09cc3185ff5"
Jul 20 18:37:13.538118 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:37:13.538101    2562 scope.go:117] "RemoveContainer" containerID="142f43b2c860a70f72d95967ded10b6a8adc265e1f4aeee189adb9333cf29569"
Jul 20 18:37:22.937624 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:37:22.937584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:37:58.083365 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:37:58.083327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:38:03.029077 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:03.029041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:38:03.214066 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:03.214032    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:38:04.178111 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:04.178080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:38:04.351899 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:04.351871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:38:09.417551 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:09.417516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:38:09.521955 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:09.521925    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:38:13.329633 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:13.329528    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:38:13.337138 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:13.337115    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw4s4_9010d336-f5bf-432d-b960-b9a225398d04/ovn-acl-logging/0.log"
Jul 20 18:38:13.567492 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:13.567455    2562 scope.go:117] "RemoveContainer" containerID="263ce1e586007fcb7a21321a21c404b570ca90f0054cca08b556bb8ddba4a87e"
Jul 20 18:38:13.575991 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:13.575971    2562 scope.go:117] "RemoveContainer" containerID="fe67daaa180943314d96d934fcb5a9f365fc0dd8d0251eb35b91dbb442f34361"
Jul 20 18:38:46.722538 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:46.722500    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:38:47.554278 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:47.554244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:38:48.574984 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:48.574950    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7284-139827283484080"]
Jul 20 18:38:48.578596 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:48.578579    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283484080"
Jul 20 18:38:48.581280 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:48.581260    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rdknw\""
Jul 20 18:38:48.585726 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:48.585699    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283484080"]
Jul 20 18:38:48.673563 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:48.673531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr6b7\" (UniqueName: \"kubernetes.io/projected/754be59c-88fc-4e41-a3ac-e41716795305-kube-api-access-wr6b7\") pod \"test-curl-7284-139827283484080\" (UID: \"754be59c-88fc-4e41-a3ac-e41716795305\") " pod="opendatahub/test-curl-7284-139827283484080"
Jul 20 18:38:48.774522 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:48.774489    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr6b7\" (UniqueName: \"kubernetes.io/projected/754be59c-88fc-4e41-a3ac-e41716795305-kube-api-access-wr6b7\") pod \"test-curl-7284-139827283484080\" (UID: \"754be59c-88fc-4e41-a3ac-e41716795305\") " pod="opendatahub/test-curl-7284-139827283484080"
Jul 20 18:38:48.783300 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:48.783270    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr6b7\" (UniqueName: \"kubernetes.io/projected/754be59c-88fc-4e41-a3ac-e41716795305-kube-api-access-wr6b7\") pod \"test-curl-7284-139827283484080\" (UID: \"754be59c-88fc-4e41-a3ac-e41716795305\") " pod="opendatahub/test-curl-7284-139827283484080"
Jul 20 18:38:48.890192 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:48.890155    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283484080"
Jul 20 18:38:49.024952 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:49.024927    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283484080"]
Jul 20 18:38:49.027073 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:38:49.027040    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod754be59c_88fc_4e41_a3ac_e41716795305.slice/crio-2a8eb43c95b20fea00cfda9b0334a3c58ff8230a9da9a121c5dd4b77909ad607 WatchSource:0}: Error finding container 2a8eb43c95b20fea00cfda9b0334a3c58ff8230a9da9a121c5dd4b77909ad607: Status 404 returned error can't find the container with id 2a8eb43c95b20fea00cfda9b0334a3c58ff8230a9da9a121c5dd4b77909ad607
Jul 20 18:38:49.028353 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:49.028329    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 18:38:49.250711 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:49.250621    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283484080" event={"ID":"754be59c-88fc-4e41-a3ac-e41716795305","Type":"ContainerStarted","Data":"2a8eb43c95b20fea00cfda9b0334a3c58ff8230a9da9a121c5dd4b77909ad607"}
Jul 20 18:38:50.257471 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:50.257438    2562 generic.go:356] "Generic (PLEG): container finished" podID="754be59c-88fc-4e41-a3ac-e41716795305" containerID="2ddc602618b14be94a84bcf24298a5d909f068955d6371a82c4f4edf29a55876" exitCode=0
Jul 20 18:38:50.257858 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:50.257484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283484080" event={"ID":"754be59c-88fc-4e41-a3ac-e41716795305","Type":"ContainerDied","Data":"2ddc602618b14be94a84bcf24298a5d909f068955d6371a82c4f4edf29a55876"}
Jul 20 18:38:51.396722 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.396700    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283484080"
Jul 20 18:38:51.423365 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.423335    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7284-139827283484080_754be59c-88fc-4e41-a3ac-e41716795305/test-curl-7284-139827283484080/0.log"
Jul 20 18:38:51.449617 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.449576    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7284-139827283484080"]
Jul 20 18:38:51.455809 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.455782    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7284-139827283484080"]
Jul 20 18:38:51.501410 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.501367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr6b7\" (UniqueName: \"kubernetes.io/projected/754be59c-88fc-4e41-a3ac-e41716795305-kube-api-access-wr6b7\") pod \"754be59c-88fc-4e41-a3ac-e41716795305\" (UID: \"754be59c-88fc-4e41-a3ac-e41716795305\") "
Jul 20 18:38:51.503789 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.503764    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/754be59c-88fc-4e41-a3ac-e41716795305-kube-api-access-wr6b7" (OuterVolumeSpecName: "kube-api-access-wr6b7") pod "754be59c-88fc-4e41-a3ac-e41716795305" (UID: "754be59c-88fc-4e41-a3ac-e41716795305"). InnerVolumeSpecName "kube-api-access-wr6b7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:38:51.578998 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.578971    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7284-139827283624624"]
Jul 20 18:38:51.579381 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.579368    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="754be59c-88fc-4e41-a3ac-e41716795305" containerName="test-curl-7284-139827283484080"
Jul 20 18:38:51.579446 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.579383    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="754be59c-88fc-4e41-a3ac-e41716795305" containerName="test-curl-7284-139827283484080"
Jul 20 18:38:51.579480 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.579471    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="754be59c-88fc-4e41-a3ac-e41716795305" containerName="test-curl-7284-139827283484080"
Jul 20 18:38:51.582506 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.582491    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283624624"
Jul 20 18:38:51.591213 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.591192    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283624624"]
Jul 20 18:38:51.602144 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.602121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z7lb\" (UniqueName: \"kubernetes.io/projected/d68e31fb-fc5a-461d-bcfb-80909c4542e6-kube-api-access-2z7lb\") pod \"test-curl-7284-139827283624624\" (UID: \"d68e31fb-fc5a-461d-bcfb-80909c4542e6\") " pod="opendatahub/test-curl-7284-139827283624624"
Jul 20 18:38:51.602275 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.602230    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr6b7\" (UniqueName: \"kubernetes.io/projected/754be59c-88fc-4e41-a3ac-e41716795305-kube-api-access-wr6b7\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:38:51.703047 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.703010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z7lb\" (UniqueName: \"kubernetes.io/projected/d68e31fb-fc5a-461d-bcfb-80909c4542e6-kube-api-access-2z7lb\") pod \"test-curl-7284-139827283624624\" (UID: \"d68e31fb-fc5a-461d-bcfb-80909c4542e6\") " pod="opendatahub/test-curl-7284-139827283624624"
Jul 20 18:38:51.712339 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.712307    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z7lb\" (UniqueName: \"kubernetes.io/projected/d68e31fb-fc5a-461d-bcfb-80909c4542e6-kube-api-access-2z7lb\") pod \"test-curl-7284-139827283624624\" (UID: \"d68e31fb-fc5a-461d-bcfb-80909c4542e6\") " pod="opendatahub/test-curl-7284-139827283624624"
Jul 20 18:38:51.894089 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:51.894057    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283624624"
Jul 20 18:38:52.033997 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:52.033974    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283624624"]
Jul 20 18:38:52.036114 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:38:52.036091    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd68e31fb_fc5a_461d_bcfb_80909c4542e6.slice/crio-b6f8d6e45166e2d301a8b9d014fccd9ba905afd891c1262c067218e18a36f609 WatchSource:0}: Error finding container b6f8d6e45166e2d301a8b9d014fccd9ba905afd891c1262c067218e18a36f609: Status 404 returned error can't find the container with id b6f8d6e45166e2d301a8b9d014fccd9ba905afd891c1262c067218e18a36f609
Jul 20 18:38:52.271036 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:52.270938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283624624" event={"ID":"d68e31fb-fc5a-461d-bcfb-80909c4542e6","Type":"ContainerStarted","Data":"b6f8d6e45166e2d301a8b9d014fccd9ba905afd891c1262c067218e18a36f609"}
Jul 20 18:38:52.272142 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:52.272124    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a8eb43c95b20fea00cfda9b0334a3c58ff8230a9da9a121c5dd4b77909ad607"
Jul 20 18:38:52.272248 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:52.272154    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283484080"
Jul 20 18:38:52.289300 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:38:52.289274    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7284-139827283484080\" is forbidden: User \"system:node:ip-10-0-141-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-126.ec2.internal' and this object" podUID="754be59c-88fc-4e41-a3ac-e41716795305" pod="opendatahub/test-curl-7284-139827283484080"
Jul 20 18:38:52.317885 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:38:52.317856    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod754be59c_88fc_4e41_a3ac_e41716795305.slice\": RecentStats: unable to find data in memory cache]"
Jul 20 18:38:53.178903 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:38:53.178870    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7284-139827283484080\" is forbidden: User \"system:node:ip-10-0-141-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-126.ec2.internal' and this object" podUID="754be59c-88fc-4e41-a3ac-e41716795305" pod="opendatahub/test-curl-7284-139827283484080"
Jul 20 18:38:53.180716 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:53.180689    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="754be59c-88fc-4e41-a3ac-e41716795305" path="/var/lib/kubelet/pods/754be59c-88fc-4e41-a3ac-e41716795305/volumes"
Jul 20 18:38:53.278367 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:53.278334    2562 generic.go:356] "Generic (PLEG): container finished" podID="d68e31fb-fc5a-461d-bcfb-80909c4542e6" containerID="f15403c1919ef45ebf485e67839c1053b4c37e3afa20751acd6bf0ef67a6d93e" exitCode=0
Jul 20 18:38:53.278565 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:53.278443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283624624" event={"ID":"d68e31fb-fc5a-461d-bcfb-80909c4542e6","Type":"ContainerDied","Data":"f15403c1919ef45ebf485e67839c1053b4c37e3afa20751acd6bf0ef67a6d93e"}
Jul 20 18:38:54.424016 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.423987    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283624624"
Jul 20 18:38:54.452172 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.452148    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7284-139827283624624_d68e31fb-fc5a-461d-bcfb-80909c4542e6/test-curl-7284-139827283624624/0.log"
Jul 20 18:38:54.483733 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.483705    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7284-139827283624624"]
Jul 20 18:38:54.485574 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.485555    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7284-139827283624624"]
Jul 20 18:38:54.532666 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.532641    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z7lb\" (UniqueName: \"kubernetes.io/projected/d68e31fb-fc5a-461d-bcfb-80909c4542e6-kube-api-access-2z7lb\") pod \"d68e31fb-fc5a-461d-bcfb-80909c4542e6\" (UID: \"d68e31fb-fc5a-461d-bcfb-80909c4542e6\") "
Jul 20 18:38:54.534820 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.534758    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68e31fb-fc5a-461d-bcfb-80909c4542e6-kube-api-access-2z7lb" (OuterVolumeSpecName: "kube-api-access-2z7lb") pod "d68e31fb-fc5a-461d-bcfb-80909c4542e6" (UID: "d68e31fb-fc5a-461d-bcfb-80909c4542e6"). InnerVolumeSpecName "kube-api-access-2z7lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:38:54.633560 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.633524    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z7lb\" (UniqueName: \"kubernetes.io/projected/d68e31fb-fc5a-461d-bcfb-80909c4542e6-kube-api-access-2z7lb\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:38:54.650131 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.650105    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7284-139827283685424"]
Jul 20 18:38:54.650582 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.650568    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68e31fb-fc5a-461d-bcfb-80909c4542e6" containerName="test-curl-7284-139827283624624"
Jul 20 18:38:54.650631 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.650585    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68e31fb-fc5a-461d-bcfb-80909c4542e6" containerName="test-curl-7284-139827283624624"
Jul 20 18:38:54.650680 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.650671    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68e31fb-fc5a-461d-bcfb-80909c4542e6" containerName="test-curl-7284-139827283624624"
Jul 20 18:38:54.653567 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.653554    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:54.663212 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.663191    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283685424"]
Jul 20 18:38:54.734042 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.734007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxrpn\" (UniqueName: \"kubernetes.io/projected/5664d4ab-5286-4bf9-818d-8903e5a05d94-kube-api-access-fxrpn\") pod \"test-curl-7284-139827283685424\" (UID: \"5664d4ab-5286-4bf9-818d-8903e5a05d94\") " pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:54.834654 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.834577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxrpn\" (UniqueName: \"kubernetes.io/projected/5664d4ab-5286-4bf9-818d-8903e5a05d94-kube-api-access-fxrpn\") pod \"test-curl-7284-139827283685424\" (UID: \"5664d4ab-5286-4bf9-818d-8903e5a05d94\") " pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:54.846010 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.845977    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxrpn\" (UniqueName: \"kubernetes.io/projected/5664d4ab-5286-4bf9-818d-8903e5a05d94-kube-api-access-fxrpn\") pod \"test-curl-7284-139827283685424\" (UID: \"5664d4ab-5286-4bf9-818d-8903e5a05d94\") " pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:54.963791 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:54.963751    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:55.103155 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:55.103131    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283685424"]
Jul 20 18:38:55.105211 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:38:55.105188    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5664d4ab_5286_4bf9_818d_8903e5a05d94.slice/crio-c43867aabfd51ecf726687df74c1da4983565032ef5311eff28943907828aa2c WatchSource:0}: Error finding container c43867aabfd51ecf726687df74c1da4983565032ef5311eff28943907828aa2c: Status 404 returned error can't find the container with id c43867aabfd51ecf726687df74c1da4983565032ef5311eff28943907828aa2c
Jul 20 18:38:55.180691 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:55.180663    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68e31fb-fc5a-461d-bcfb-80909c4542e6" path="/var/lib/kubelet/pods/d68e31fb-fc5a-461d-bcfb-80909c4542e6/volumes"
Jul 20 18:38:55.290560 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:55.290522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283685424" event={"ID":"5664d4ab-5286-4bf9-818d-8903e5a05d94","Type":"ContainerStarted","Data":"c43867aabfd51ecf726687df74c1da4983565032ef5311eff28943907828aa2c"}
Jul 20 18:38:55.291853 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:55.291830    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283624624"
Jul 20 18:38:55.291987 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:55.291855    2562 scope.go:117] "RemoveContainer" containerID="f15403c1919ef45ebf485e67839c1053b4c37e3afa20751acd6bf0ef67a6d93e"
Jul 20 18:38:56.299082 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:56.299045    2562 generic.go:356] "Generic (PLEG): container finished" podID="5664d4ab-5286-4bf9-818d-8903e5a05d94" containerID="9aace8e613878943d19f994d98cf132b0346cb31218e685fc673e428ab97393a" exitCode=0
Jul 20 18:38:56.299538 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:56.299128    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283685424" event={"ID":"5664d4ab-5286-4bf9-818d-8903e5a05d94","Type":"ContainerDied","Data":"9aace8e613878943d19f994d98cf132b0346cb31218e685fc673e428ab97393a"}
Jul 20 18:38:57.449896 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.449871    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:57.472998 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.472975    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7284-139827283685424_5664d4ab-5286-4bf9-818d-8903e5a05d94/test-curl-7284-139827283685424/0.log"
Jul 20 18:38:57.502316 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.502285    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7284-139827283685424"]
Jul 20 18:38:57.508240 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.508220    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7284-139827283685424"]
Jul 20 18:38:57.559223 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.559131    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxrpn\" (UniqueName: \"kubernetes.io/projected/5664d4ab-5286-4bf9-818d-8903e5a05d94-kube-api-access-fxrpn\") pod \"5664d4ab-5286-4bf9-818d-8903e5a05d94\" (UID: \"5664d4ab-5286-4bf9-818d-8903e5a05d94\") "
Jul 20 18:38:57.561268 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.561241    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5664d4ab-5286-4bf9-818d-8903e5a05d94-kube-api-access-fxrpn" (OuterVolumeSpecName: "kube-api-access-fxrpn") pod "5664d4ab-5286-4bf9-818d-8903e5a05d94" (UID: "5664d4ab-5286-4bf9-818d-8903e5a05d94"). InnerVolumeSpecName "kube-api-access-fxrpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:38:57.637049 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.637016    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7284-139827283685424"]
Jul 20 18:38:57.637484 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.637471    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5664d4ab-5286-4bf9-818d-8903e5a05d94" containerName="test-curl-7284-139827283685424"
Jul 20 18:38:57.637537 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.637486    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5664d4ab-5286-4bf9-818d-8903e5a05d94" containerName="test-curl-7284-139827283685424"
Jul 20 18:38:57.637572 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.637551    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5664d4ab-5286-4bf9-818d-8903e5a05d94" containerName="test-curl-7284-139827283685424"
Jul 20 18:38:57.640536 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.640521    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:57.647927 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.647900    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283685424"]
Jul 20 18:38:57.660846 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.660821    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxrpn\" (UniqueName: \"kubernetes.io/projected/5664d4ab-5286-4bf9-818d-8903e5a05d94-kube-api-access-fxrpn\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:38:57.762226 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.762190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zqcg\" (UniqueName: \"kubernetes.io/projected/a837ebcb-3e9e-420c-ae23-0a71326884dd-kube-api-access-7zqcg\") pod \"test-curl-7284-139827283685424\" (UID: \"a837ebcb-3e9e-420c-ae23-0a71326884dd\") " pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:57.863406 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.863351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zqcg\" (UniqueName: \"kubernetes.io/projected/a837ebcb-3e9e-420c-ae23-0a71326884dd-kube-api-access-7zqcg\") pod \"test-curl-7284-139827283685424\" (UID: \"a837ebcb-3e9e-420c-ae23-0a71326884dd\") " pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:57.872833 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.872805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zqcg\" (UniqueName: \"kubernetes.io/projected/a837ebcb-3e9e-420c-ae23-0a71326884dd-kube-api-access-7zqcg\") pod \"test-curl-7284-139827283685424\" (UID: \"a837ebcb-3e9e-420c-ae23-0a71326884dd\") " pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:57.950779 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:57.950746    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:58.088907 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:58.088878    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283685424"]
Jul 20 18:38:58.091639 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:38:58.091608    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda837ebcb_3e9e_420c_ae23_0a71326884dd.slice/crio-6e0c64c7f571f06269c2d833cf5ac41c1d83a16b35b3f39ace8b0739d63579e7 WatchSource:0}: Error finding container 6e0c64c7f571f06269c2d833cf5ac41c1d83a16b35b3f39ace8b0739d63579e7: Status 404 returned error can't find the container with id 6e0c64c7f571f06269c2d833cf5ac41c1d83a16b35b3f39ace8b0739d63579e7
Jul 20 18:38:58.311341 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:58.311307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283685424" event={"ID":"a837ebcb-3e9e-420c-ae23-0a71326884dd","Type":"ContainerStarted","Data":"6e0c64c7f571f06269c2d833cf5ac41c1d83a16b35b3f39ace8b0739d63579e7"}
Jul 20 18:38:58.312560 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:58.312537    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:38:58.312688 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:58.312572    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c43867aabfd51ecf726687df74c1da4983565032ef5311eff28943907828aa2c"
Jul 20 18:38:58.324982 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:58.324950    2562 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7284-139827283685424" oldPodUID="5664d4ab-5286-4bf9-818d-8903e5a05d94" podUID="a837ebcb-3e9e-420c-ae23-0a71326884dd"
Jul 20 18:38:59.181019 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:59.180988    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5664d4ab-5286-4bf9-818d-8903e5a05d94" path="/var/lib/kubelet/pods/5664d4ab-5286-4bf9-818d-8903e5a05d94/volumes"
Jul 20 18:38:59.319759 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:59.319729    2562 generic.go:356] "Generic (PLEG): container finished" podID="a837ebcb-3e9e-420c-ae23-0a71326884dd" containerID="372d280ef2d23de51127a7b32efd7d2bae09ed499ea3b538c89c4681dc630644" exitCode=0
Jul 20 18:38:59.319932 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:38:59.319820    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283685424" event={"ID":"a837ebcb-3e9e-420c-ae23-0a71326884dd","Type":"ContainerDied","Data":"372d280ef2d23de51127a7b32efd7d2bae09ed499ea3b538c89c4681dc630644"}
Jul 20 18:39:00.468040 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.468016    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:39:00.490265 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.490227    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7284-139827283685424_a837ebcb-3e9e-420c-ae23-0a71326884dd/test-curl-7284-139827283685424/0.log"
Jul 20 18:39:00.516248 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.516166    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7284-139827283685424"]
Jul 20 18:39:00.518703 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.518681    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7284-139827283685424"]
Jul 20 18:39:00.590546 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.590516    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zqcg\" (UniqueName: \"kubernetes.io/projected/a837ebcb-3e9e-420c-ae23-0a71326884dd-kube-api-access-7zqcg\") pod \"a837ebcb-3e9e-420c-ae23-0a71326884dd\" (UID: \"a837ebcb-3e9e-420c-ae23-0a71326884dd\") "
Jul 20 18:39:00.592795 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.592760    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a837ebcb-3e9e-420c-ae23-0a71326884dd-kube-api-access-7zqcg" (OuterVolumeSpecName: "kube-api-access-7zqcg") pod "a837ebcb-3e9e-420c-ae23-0a71326884dd" (UID: "a837ebcb-3e9e-420c-ae23-0a71326884dd"). InnerVolumeSpecName "kube-api-access-7zqcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:39:00.655008 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.654974    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7284-139827283575840"]
Jul 20 18:39:00.655467 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.655452    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a837ebcb-3e9e-420c-ae23-0a71326884dd" containerName="test-curl-7284-139827283685424"
Jul 20 18:39:00.655467 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.655467    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a837ebcb-3e9e-420c-ae23-0a71326884dd" containerName="test-curl-7284-139827283685424"
Jul 20 18:39:00.655571 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.655535    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a837ebcb-3e9e-420c-ae23-0a71326884dd" containerName="test-curl-7284-139827283685424"
Jul 20 18:39:00.658274 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.658258    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:00.665684 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.665660    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283575840"]
Jul 20 18:39:00.691837 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.691800    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkv54\" (UniqueName: \"kubernetes.io/projected/f98eeedd-14ec-4508-9fd6-bdd1b254f2a0-kube-api-access-hkv54\") pod \"test-curl-7284-139827283575840\" (UID: \"f98eeedd-14ec-4508-9fd6-bdd1b254f2a0\") " pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:00.691966 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.691858    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zqcg\" (UniqueName: \"kubernetes.io/projected/a837ebcb-3e9e-420c-ae23-0a71326884dd-kube-api-access-7zqcg\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:39:00.709325 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.709300    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:00.793291 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.793259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkv54\" (UniqueName: \"kubernetes.io/projected/f98eeedd-14ec-4508-9fd6-bdd1b254f2a0-kube-api-access-hkv54\") pod \"test-curl-7284-139827283575840\" (UID: \"f98eeedd-14ec-4508-9fd6-bdd1b254f2a0\") " pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:00.802550 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.802526    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkv54\" (UniqueName: \"kubernetes.io/projected/f98eeedd-14ec-4508-9fd6-bdd1b254f2a0-kube-api-access-hkv54\") pod \"test-curl-7284-139827283575840\" (UID: \"f98eeedd-14ec-4508-9fd6-bdd1b254f2a0\") " pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:00.968664 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:00.968571    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:01.105425 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:01.105385    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283575840"]
Jul 20 18:39:01.107298 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:39:01.107270    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf98eeedd_14ec_4508_9fd6_bdd1b254f2a0.slice/crio-5220c14b07442c149acf8c979bdc66476d95200b867ed4b025aad04a2c5a09be WatchSource:0}: Error finding container 5220c14b07442c149acf8c979bdc66476d95200b867ed4b025aad04a2c5a09be: Status 404 returned error can't find the container with id 5220c14b07442c149acf8c979bdc66476d95200b867ed4b025aad04a2c5a09be
Jul 20 18:39:01.180689 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:01.180657    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a837ebcb-3e9e-420c-ae23-0a71326884dd" path="/var/lib/kubelet/pods/a837ebcb-3e9e-420c-ae23-0a71326884dd/volumes"
Jul 20 18:39:01.333034 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:01.332926    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283575840" event={"ID":"f98eeedd-14ec-4508-9fd6-bdd1b254f2a0","Type":"ContainerStarted","Data":"5220c14b07442c149acf8c979bdc66476d95200b867ed4b025aad04a2c5a09be"}
Jul 20 18:39:01.334599 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:01.334579    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283685424"
Jul 20 18:39:01.334751 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:01.334578    2562 scope.go:117] "RemoveContainer" containerID="372d280ef2d23de51127a7b32efd7d2bae09ed499ea3b538c89c4681dc630644"
Jul 20 18:39:02.340718 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:02.340682    2562 generic.go:356] "Generic (PLEG): container finished" podID="f98eeedd-14ec-4508-9fd6-bdd1b254f2a0" containerID="33bba55430f3f0764cfa438f0cb1630587870af4d69e13f76e9d2a6c81b650c7" exitCode=0
Jul 20 18:39:02.341162 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:02.340762    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283575840" event={"ID":"f98eeedd-14ec-4508-9fd6-bdd1b254f2a0","Type":"ContainerDied","Data":"33bba55430f3f0764cfa438f0cb1630587870af4d69e13f76e9d2a6c81b650c7"}
Jul 20 18:39:03.484910 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.484875    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:03.505789 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.505761    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7284-139827283575840_f98eeedd-14ec-4508-9fd6-bdd1b254f2a0/test-curl-7284-139827283575840/0.log"
Jul 20 18:39:03.532514 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.532485    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7284-139827283575840"]
Jul 20 18:39:03.536376 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.536353    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7284-139827283575840"]
Jul 20 18:39:03.622988 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.622904    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkv54\" (UniqueName: \"kubernetes.io/projected/f98eeedd-14ec-4508-9fd6-bdd1b254f2a0-kube-api-access-hkv54\") pod \"f98eeedd-14ec-4508-9fd6-bdd1b254f2a0\" (UID: \"f98eeedd-14ec-4508-9fd6-bdd1b254f2a0\") "
Jul 20 18:39:03.625069 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.625039    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f98eeedd-14ec-4508-9fd6-bdd1b254f2a0-kube-api-access-hkv54" (OuterVolumeSpecName: "kube-api-access-hkv54") pod "f98eeedd-14ec-4508-9fd6-bdd1b254f2a0" (UID: "f98eeedd-14ec-4508-9fd6-bdd1b254f2a0"). InnerVolumeSpecName "kube-api-access-hkv54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:39:03.683207 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.683137    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7284-139827283575840"]
Jul 20 18:39:03.683803 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.683786    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f98eeedd-14ec-4508-9fd6-bdd1b254f2a0" containerName="test-curl-7284-139827283575840"
Jul 20 18:39:03.683847 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.683806    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f98eeedd-14ec-4508-9fd6-bdd1b254f2a0" containerName="test-curl-7284-139827283575840"
Jul 20 18:39:03.683897 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.683888    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f98eeedd-14ec-4508-9fd6-bdd1b254f2a0" containerName="test-curl-7284-139827283575840"
Jul 20 18:39:03.686868 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.686851    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:03.704656 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.704629    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283575840"]
Jul 20 18:39:03.723642 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.723608    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkv54\" (UniqueName: \"kubernetes.io/projected/f98eeedd-14ec-4508-9fd6-bdd1b254f2a0-kube-api-access-hkv54\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:39:03.825060 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.825026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d4hp\" (UniqueName: \"kubernetes.io/projected/8c57f479-1777-4b10-9edd-4fd24ef0872a-kube-api-access-7d4hp\") pod \"test-curl-7284-139827283575840\" (UID: \"8c57f479-1777-4b10-9edd-4fd24ef0872a\") " pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:03.925791 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.925702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d4hp\" (UniqueName: \"kubernetes.io/projected/8c57f479-1777-4b10-9edd-4fd24ef0872a-kube-api-access-7d4hp\") pod \"test-curl-7284-139827283575840\" (UID: \"8c57f479-1777-4b10-9edd-4fd24ef0872a\") " pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:03.936226 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.936191    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d4hp\" (UniqueName: \"kubernetes.io/projected/8c57f479-1777-4b10-9edd-4fd24ef0872a-kube-api-access-7d4hp\") pod \"test-curl-7284-139827283575840\" (UID: \"8c57f479-1777-4b10-9edd-4fd24ef0872a\") " pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:03.995948 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:03.995920    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:04.352561 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:04.352529    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:04.352561 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:04.352560    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5220c14b07442c149acf8c979bdc66476d95200b867ed4b025aad04a2c5a09be"
Jul 20 18:39:04.364688 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:04.364608    2562 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7284-139827283575840" oldPodUID="f98eeedd-14ec-4508-9fd6-bdd1b254f2a0" podUID="8c57f479-1777-4b10-9edd-4fd24ef0872a"
Jul 20 18:39:04.365882 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:04.365863    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7284-139827283575840"]
Jul 20 18:39:04.367485 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:39:04.367463    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c57f479_1777_4b10_9edd_4fd24ef0872a.slice/crio-df6e59b29d187b02ee15df8e54447666fedb66074518464a8fdb698ca86325c8 WatchSource:0}: Error finding container df6e59b29d187b02ee15df8e54447666fedb66074518464a8fdb698ca86325c8: Status 404 returned error can't find the container with id df6e59b29d187b02ee15df8e54447666fedb66074518464a8fdb698ca86325c8
Jul 20 18:39:05.181262 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:05.181231    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f98eeedd-14ec-4508-9fd6-bdd1b254f2a0" path="/var/lib/kubelet/pods/f98eeedd-14ec-4508-9fd6-bdd1b254f2a0/volumes"
Jul 20 18:39:05.359409 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:05.359362    2562 generic.go:356] "Generic (PLEG): container finished" podID="8c57f479-1777-4b10-9edd-4fd24ef0872a" containerID="2b17bdf8a08b7cb1733c578a0a02c6f7847a7db903641945cf428bfe059af4cc" exitCode=0
Jul 20 18:39:05.359579 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:05.359458    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283575840" event={"ID":"8c57f479-1777-4b10-9edd-4fd24ef0872a","Type":"ContainerDied","Data":"2b17bdf8a08b7cb1733c578a0a02c6f7847a7db903641945cf428bfe059af4cc"}
Jul 20 18:39:05.359579 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:05.359500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7284-139827283575840" event={"ID":"8c57f479-1777-4b10-9edd-4fd24ef0872a","Type":"ContainerStarted","Data":"df6e59b29d187b02ee15df8e54447666fedb66074518464a8fdb698ca86325c8"}
Jul 20 18:39:06.505889 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.505866    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:06.529438 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.529415    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7284-139827283575840_8c57f479-1777-4b10-9edd-4fd24ef0872a/test-curl-7284-139827283575840/0.log"
Jul 20 18:39:06.559795 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.559764    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7284-139827283575840"]
Jul 20 18:39:06.564444 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.564420    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7284-139827283575840"]
Jul 20 18:39:06.653556 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.653475    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d4hp\" (UniqueName: \"kubernetes.io/projected/8c57f479-1777-4b10-9edd-4fd24ef0872a-kube-api-access-7d4hp\") pod \"8c57f479-1777-4b10-9edd-4fd24ef0872a\" (UID: \"8c57f479-1777-4b10-9edd-4fd24ef0872a\") "
Jul 20 18:39:06.655623 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.655598    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c57f479-1777-4b10-9edd-4fd24ef0872a-kube-api-access-7d4hp" (OuterVolumeSpecName: "kube-api-access-7d4hp") pod "8c57f479-1777-4b10-9edd-4fd24ef0872a" (UID: "8c57f479-1777-4b10-9edd-4fd24ef0872a"). InnerVolumeSpecName "kube-api-access-7d4hp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:39:06.754605 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.754578    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d4hp\" (UniqueName: \"kubernetes.io/projected/8c57f479-1777-4b10-9edd-4fd24ef0872a-kube-api-access-7d4hp\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:39:06.786768 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.786740    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"]
Jul 20 18:39:06.787150 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.787138    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c57f479-1777-4b10-9edd-4fd24ef0872a" containerName="test-curl-7284-139827283575840"
Jul 20 18:39:06.787205 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.787152    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c57f479-1777-4b10-9edd-4fd24ef0872a" containerName="test-curl-7284-139827283575840"
Jul 20 18:39:06.787259 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.787244    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c57f479-1777-4b10-9edd-4fd24ef0872a" containerName="test-curl-7284-139827283575840"
Jul 20 18:39:06.790139 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.790126    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"
Jul 20 18:39:06.793794 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.793777    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:39:06.803292 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.803268    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"]
Jul 20 18:39:06.855837 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.855810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/016c4094-5e5e-499b-8bb0-24be431f2e0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf\" (UID: \"016c4094-5e5e-499b-8bb0-24be431f2e0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"
Jul 20 18:39:06.956832 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.956750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/016c4094-5e5e-499b-8bb0-24be431f2e0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf\" (UID: \"016c4094-5e5e-499b-8bb0-24be431f2e0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"
Jul 20 18:39:06.957380 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:06.957361    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/016c4094-5e5e-499b-8bb0-24be431f2e0c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf\" (UID: \"016c4094-5e5e-499b-8bb0-24be431f2e0c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"
Jul 20 18:39:07.100155 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:07.100126    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"
Jul 20 18:39:07.180778 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:07.180746    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c57f479-1777-4b10-9edd-4fd24ef0872a" path="/var/lib/kubelet/pods/8c57f479-1777-4b10-9edd-4fd24ef0872a/volumes"
Jul 20 18:39:07.249976 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:07.249892    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"]
Jul 20 18:39:07.252244 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:39:07.252218    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016c4094_5e5e_499b_8bb0_24be431f2e0c.slice/crio-6d7dfc095b7d606c9f52c1b9082b70d5d277216e8de9453cda7d9755849d98d0 WatchSource:0}: Error finding container 6d7dfc095b7d606c9f52c1b9082b70d5d277216e8de9453cda7d9755849d98d0: Status 404 returned error can't find the container with id 6d7dfc095b7d606c9f52c1b9082b70d5d277216e8de9453cda7d9755849d98d0
Jul 20 18:39:07.370949 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:07.370912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf" event={"ID":"016c4094-5e5e-499b-8bb0-24be431f2e0c","Type":"ContainerStarted","Data":"6d7dfc095b7d606c9f52c1b9082b70d5d277216e8de9453cda7d9755849d98d0"}
Jul 20 18:39:07.372142 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:07.372126    2562 scope.go:117] "RemoveContainer" containerID="2b17bdf8a08b7cb1733c578a0a02c6f7847a7db903641945cf428bfe059af4cc"
Jul 20 18:39:07.372142 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:07.372145    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7284-139827283575840"
Jul 20 18:39:07.495869 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:07.495842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:07.596901 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:07.596863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:08.379856 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:08.379820    2562 generic.go:356] "Generic (PLEG): container finished" podID="016c4094-5e5e-499b-8bb0-24be431f2e0c" containerID="b53d78331a62b6d29ddac5c5dab48e26a068308f848cbd8e99594a7e0e4edcd6" exitCode=0
Jul 20 18:39:08.380032 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:08.379905    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf" event={"ID":"016c4094-5e5e-499b-8bb0-24be431f2e0c","Type":"ContainerDied","Data":"b53d78331a62b6d29ddac5c5dab48e26a068308f848cbd8e99594a7e0e4edcd6"}
Jul 20 18:39:09.517259 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:09.517235    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"
Jul 20 18:39:09.580489 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:09.580460    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/016c4094-5e5e-499b-8bb0-24be431f2e0c-maas-api-service-ca\") pod \"016c4094-5e5e-499b-8bb0-24be431f2e0c\" (UID: \"016c4094-5e5e-499b-8bb0-24be431f2e0c\") "
Jul 20 18:39:09.580816 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:09.580796    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016c4094-5e5e-499b-8bb0-24be431f2e0c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "016c4094-5e5e-499b-8bb0-24be431f2e0c" (UID: "016c4094-5e5e-499b-8bb0-24be431f2e0c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:39:09.681513 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:09.681432    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/016c4094-5e5e-499b-8bb0-24be431f2e0c-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:39:10.392518 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:10.392491    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"
Jul 20 18:39:10.392685 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:10.392491    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf" event={"ID":"016c4094-5e5e-499b-8bb0-24be431f2e0c","Type":"ContainerDied","Data":"6d7dfc095b7d606c9f52c1b9082b70d5d277216e8de9453cda7d9755849d98d0"}
Jul 20 18:39:10.392685 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:10.392624    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d7dfc095b7d606c9f52c1b9082b70d5d277216e8de9453cda7d9755849d98d0"
Jul 20 18:39:17.308161 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.308130    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"]
Jul 20 18:39:17.308650 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.308337    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp" podUID="03e476b1-5da1-4c36-a469-290a3c8b0d03" containerName="maas-api" containerID="cri-o://ff65c3a613fd5a9cc32763b87f3f5481d8ee9945ab4b4d07dc3abf3697b35b66" gracePeriod=30
Jul 20 18:39:17.319139 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.319095    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp" podUID="03e476b1-5da1-4c36-a469-290a3c8b0d03" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.62:8443/health\": dial tcp 10.134.0.62:8443: connect: connection refused"
Jul 20 18:39:17.370956 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.370908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:17.431239 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.431210    2562 generic.go:356] "Generic (PLEG): container finished" podID="03e476b1-5da1-4c36-a469-290a3c8b0d03" containerID="ff65c3a613fd5a9cc32763b87f3f5481d8ee9945ab4b4d07dc3abf3697b35b66" exitCode=0
Jul 20 18:39:17.431349 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.431264    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp" event={"ID":"03e476b1-5da1-4c36-a469-290a3c8b0d03","Type":"ContainerDied","Data":"ff65c3a613fd5a9cc32763b87f3f5481d8ee9945ab4b4d07dc3abf3697b35b66"}
Jul 20 18:39:17.569740 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.569679    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:39:17.655620 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.655586    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cccz\" (UniqueName: \"kubernetes.io/projected/03e476b1-5da1-4c36-a469-290a3c8b0d03-kube-api-access-7cccz\") pod \"03e476b1-5da1-4c36-a469-290a3c8b0d03\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") "
Jul 20 18:39:17.655832 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.655655    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e476b1-5da1-4c36-a469-290a3c8b0d03-openshift-service-ca\") pod \"03e476b1-5da1-4c36-a469-290a3c8b0d03\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") "
Jul 20 18:39:17.655832 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.655746    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e476b1-5da1-4c36-a469-290a3c8b0d03-maas-api-tls\") pod \"03e476b1-5da1-4c36-a469-290a3c8b0d03\" (UID: \"03e476b1-5da1-4c36-a469-290a3c8b0d03\") "
Jul 20 18:39:17.656022 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.655999    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03e476b1-5da1-4c36-a469-290a3c8b0d03-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03e476b1-5da1-4c36-a469-290a3c8b0d03" (UID: "03e476b1-5da1-4c36-a469-290a3c8b0d03"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:39:17.657916 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.657882    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03e476b1-5da1-4c36-a469-290a3c8b0d03-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03e476b1-5da1-4c36-a469-290a3c8b0d03" (UID: "03e476b1-5da1-4c36-a469-290a3c8b0d03"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:39:17.658027 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.657934    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03e476b1-5da1-4c36-a469-290a3c8b0d03-kube-api-access-7cccz" (OuterVolumeSpecName: "kube-api-access-7cccz") pod "03e476b1-5da1-4c36-a469-290a3c8b0d03" (UID: "03e476b1-5da1-4c36-a469-290a3c8b0d03"). InnerVolumeSpecName "kube-api-access-7cccz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:39:17.756436 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.756401    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cccz\" (UniqueName: \"kubernetes.io/projected/03e476b1-5da1-4c36-a469-290a3c8b0d03-kube-api-access-7cccz\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:39:17.756436 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.756429    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03e476b1-5da1-4c36-a469-290a3c8b0d03-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:39:17.756436 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:17.756439    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03e476b1-5da1-4c36-a469-290a3c8b0d03-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:39:18.437820 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:18.437798    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"
Jul 20 18:39:18.438271 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:18.437827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp" event={"ID":"03e476b1-5da1-4c36-a469-290a3c8b0d03","Type":"ContainerDied","Data":"a4d9a06874834ededad426be7cd1bb7048d603ed049b884506cb18c23c1c7ea8"}
Jul 20 18:39:18.438271 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:18.437907    2562 scope.go:117] "RemoveContainer" containerID="ff65c3a613fd5a9cc32763b87f3f5481d8ee9945ab4b4d07dc3abf3697b35b66"
Jul 20 18:39:18.465324 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:18.465291    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"]
Jul 20 18:39:18.469175 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:18.469147    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-daa21b-5f74b5497b-9b9lp"]
Jul 20 18:39:19.181293 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:19.181257    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03e476b1-5da1-4c36-a469-290a3c8b0d03" path="/var/lib/kubelet/pods/03e476b1-5da1-4c36-a469-290a3c8b0d03/volumes"
Jul 20 18:39:21.849249 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:21.849218    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:21.866237 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:21.866210    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"]
Jul 20 18:39:21.869278 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:21.869254    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-daa21b-9ptrf"]
Jul 20 18:39:22.288995 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:22.288908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:23.180528 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:23.180493    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016c4094-5e5e-499b-8bb0-24be431f2e0c" path="/var/lib/kubelet/pods/016c4094-5e5e-499b-8bb0-24be431f2e0c/volumes"
Jul 20 18:39:28.259346 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:28.259308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:28.996849 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:28.996809    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"]
Jul 20 18:39:28.997484 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:28.997466    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016c4094-5e5e-499b-8bb0-24be431f2e0c" containerName="revoke-keys"
Jul 20 18:39:28.997539 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:28.997488    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="016c4094-5e5e-499b-8bb0-24be431f2e0c" containerName="revoke-keys"
Jul 20 18:39:28.997539 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:28.997519    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e476b1-5da1-4c36-a469-290a3c8b0d03" containerName="maas-api"
Jul 20 18:39:28.997539 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:28.997528    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e476b1-5da1-4c36-a469-290a3c8b0d03" containerName="maas-api"
Jul 20 18:39:28.997642 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:28.997630    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="016c4094-5e5e-499b-8bb0-24be431f2e0c" containerName="revoke-keys"
Jul 20 18:39:28.997675 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:28.997647    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="03e476b1-5da1-4c36-a469-290a3c8b0d03" containerName="maas-api"
Jul 20 18:39:29.001310 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.001294    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"
Jul 20 18:39:29.005959 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.005940    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b9wjn\""
Jul 20 18:39:29.023090 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.023067    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"]
Jul 20 18:39:29.165363 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.165328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a07c83d1-970d-439d-bb4a-17f3220f2e07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d56278-t88gh\" (UID: \"a07c83d1-970d-439d-bb4a-17f3220f2e07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"
Jul 20 18:39:29.266163 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.266074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a07c83d1-970d-439d-bb4a-17f3220f2e07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d56278-t88gh\" (UID: \"a07c83d1-970d-439d-bb4a-17f3220f2e07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"
Jul 20 18:39:29.266686 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.266666    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a07c83d1-970d-439d-bb4a-17f3220f2e07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d56278-t88gh\" (UID: \"a07c83d1-970d-439d-bb4a-17f3220f2e07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"
Jul 20 18:39:29.311657 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.311625    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"
Jul 20 18:39:29.447753 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.447730    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"]
Jul 20 18:39:29.449790 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:39:29.449753    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07c83d1_970d_439d_bb4a_17f3220f2e07.slice/crio-1ac2b9fc5c85b29b23a7a968e6daf8bd72eb9a46aebf9ed04a76804638ebea93 WatchSource:0}: Error finding container 1ac2b9fc5c85b29b23a7a968e6daf8bd72eb9a46aebf9ed04a76804638ebea93: Status 404 returned error can't find the container with id 1ac2b9fc5c85b29b23a7a968e6daf8bd72eb9a46aebf9ed04a76804638ebea93
Jul 20 18:39:29.501298 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.501263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh" event={"ID":"a07c83d1-970d-439d-bb4a-17f3220f2e07","Type":"ContainerStarted","Data":"1ac2b9fc5c85b29b23a7a968e6daf8bd72eb9a46aebf9ed04a76804638ebea93"}
Jul 20 18:39:29.610410 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.610366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:29.742507 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.742469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:29.842477 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.842436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:29.949913 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:29.949816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:30.508249 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:30.508213    2562 generic.go:356] "Generic (PLEG): container finished" podID="a07c83d1-970d-439d-bb4a-17f3220f2e07" containerID="753be340f15d0684e10714b394b58369ab99c00a94f4199d11d41ec5ce41ec43" exitCode=0
Jul 20 18:39:30.508636 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:30.508305    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh" event={"ID":"a07c83d1-970d-439d-bb4a-17f3220f2e07","Type":"ContainerDied","Data":"753be340f15d0684e10714b394b58369ab99c00a94f4199d11d41ec5ce41ec43"}
Jul 20 18:39:31.649966 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:31.649939    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"
Jul 20 18:39:31.685225 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:31.685201    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a07c83d1-970d-439d-bb4a-17f3220f2e07-maas-api-service-ca\") pod \"a07c83d1-970d-439d-bb4a-17f3220f2e07\" (UID: \"a07c83d1-970d-439d-bb4a-17f3220f2e07\") "
Jul 20 18:39:31.685592 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:31.685566    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a07c83d1-970d-439d-bb4a-17f3220f2e07-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a07c83d1-970d-439d-bb4a-17f3220f2e07" (UID: "a07c83d1-970d-439d-bb4a-17f3220f2e07"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:39:31.785899 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:31.785820    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a07c83d1-970d-439d-bb4a-17f3220f2e07-maas-api-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:39:32.521009 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:32.520983    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"
Jul 20 18:39:32.521009 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:32.520998    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh" event={"ID":"a07c83d1-970d-439d-bb4a-17f3220f2e07","Type":"ContainerDied","Data":"1ac2b9fc5c85b29b23a7a968e6daf8bd72eb9a46aebf9ed04a76804638ebea93"}
Jul 20 18:39:32.521219 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:32.521040    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ac2b9fc5c85b29b23a7a968e6daf8bd72eb9a46aebf9ed04a76804638ebea93"
Jul 20 18:39:39.518383 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.518351    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"]
Jul 20 18:39:39.518980 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.518627    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb" podUID="b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9" containerName="maas-api" containerID="cri-o://33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc" gracePeriod=30
Jul 20 18:39:39.547591 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.547565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:39.771682 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.771626    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:39:39.847726 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.847698    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-maas-api-tls\") pod \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") "
Jul 20 18:39:39.847896 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.847797    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-openshift-service-ca\") pod \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") "
Jul 20 18:39:39.847896 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.847825    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9mvq\" (UniqueName: \"kubernetes.io/projected/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-kube-api-access-c9mvq\") pod \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\" (UID: \"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9\") "
Jul 20 18:39:39.848179 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.848154    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9" (UID: "b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 18:39:39.849960 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.849937    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9" (UID: "b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 18:39:39.850050 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.850005    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-kube-api-access-c9mvq" (OuterVolumeSpecName: "kube-api-access-c9mvq") pod "b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9" (UID: "b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9"). InnerVolumeSpecName "kube-api-access-c9mvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 18:39:39.948754 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.948719    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-openshift-service-ca\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:39:39.948754 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.948749    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9mvq\" (UniqueName: \"kubernetes.io/projected/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-kube-api-access-c9mvq\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:39:39.948946 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:39.948762    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9-maas-api-tls\") on node \"ip-10-0-141-126.ec2.internal\" DevicePath \"\""
Jul 20 18:39:40.566085 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:40.566056    2562 generic.go:356] "Generic (PLEG): container finished" podID="b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9" containerID="33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc" exitCode=0
Jul 20 18:39:40.566597 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:40.566111    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"
Jul 20 18:39:40.566597 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:40.566132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb" event={"ID":"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9","Type":"ContainerDied","Data":"33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc"}
Jul 20 18:39:40.566597 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:40.566183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb" event={"ID":"b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9","Type":"ContainerDied","Data":"ea2fc37fb80553b0bd6254f5e36504938ec8f0caccf060b20a9b281116cfe172"}
Jul 20 18:39:40.566597 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:40.566206    2562 scope.go:117] "RemoveContainer" containerID="33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc"
Jul 20 18:39:40.575749 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:40.575732    2562 scope.go:117] "RemoveContainer" containerID="33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc"
Jul 20 18:39:40.575995 ip-10-0-141-126 kubenswrapper[2562]: E0720 18:39:40.575977    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc\": container with ID starting with 33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc not found: ID does not exist" containerID="33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc"
Jul 20 18:39:40.576034 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:40.576005    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc"} err="failed to get container status \"33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc\": rpc error: code = NotFound desc = could not find container \"33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc\": container with ID starting with 33047b3866d4768c6cf441bb3e40b54f1257bf0fb680114cd23dea28888a28dc not found: ID does not exist"
Jul 20 18:39:40.604345 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:40.604317    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"]
Jul 20 18:39:40.607738 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:40.607716    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d56278-6589986bc6-fjfbb"]
Jul 20 18:39:41.180977 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:41.180942    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9" path="/var/lib/kubelet/pods/b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9/volumes"
Jul 20 18:39:44.150233 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:44.150197    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:44.151239 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:44.151214    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"]
Jul 20 18:39:44.156433 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:44.156412    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d56278-t88gh"]
Jul 20 18:39:44.644758 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:44.644725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:45.180502 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:45.180470    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a07c83d1-970d-439d-bb4a-17f3220f2e07" path="/var/lib/kubelet/pods/a07c83d1-970d-439d-bb4a-17f3220f2e07/volumes"
Jul 20 18:39:51.158026 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:51.157991    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:51.274272 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:51.274229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:51.504128 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:51.504040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:51.806151 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:51.806063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:39:59.583703 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:59.583676    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8f8bd966-tk9zh_6465f52e-70e1-4556-a680-3cd56b964666/copy-manifests/0.log"
Jul 20 18:39:59.592313 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:59.592288    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8f8bd966-tk9zh_6465f52e-70e1-4556-a680-3cd56b964666/manager/0.log"
Jul 20 18:39:59.960252 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:39:59.960227    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b976987d9-g8rhc_d89606c9-06ab-4a75-b828-06b1d21d8c60/maas-api/0.log"
Jul 20 18:40:00.087631 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:00.087603    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742855-jrnkq_e7007205-3d05-4e57-a539-b09163f9d2e3/cleanup/0.log"
Jul 20 18:40:00.214962 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:00.214882    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742870-w8hgb_b7bd21be-57a9-4415-919a-91ed28d3b806/cleanup/0.log"
Jul 20 18:40:02.231652 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:02.231622    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-98q8f_53daaf45-ba03-4b8d-9df0-32811e35a462/kuadrant-console-plugin/0.log"
Jul 20 18:40:02.500475 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:02.500403    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qhfsq_afce5815-e25c-4021-86dd-b9d749addc50/manager/0.log"
Jul 20 18:40:03.496923 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:03.496892    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b99948476-bwncd_8a2c9e70-f3ac-4853-ad63-a300f0636382/kube-auth-proxy/0.log"
Jul 20 18:40:04.153830 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:04.153800    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc67f49fb-pmswb_b4463355-2bf6-4ca6-bdcb-67dfa1131a2a/router/0.log"
Jul 20 18:40:04.824606 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:04.824580    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2pccs_ca4d0b2e-6f7c-438d-bc75-cc47142bfab6/main/0.log"
Jul 20 18:40:05.218221 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:05.218193    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-p28wt_f12596dd-4156-4a89-9412-4afed078f30d/main/0.log"
Jul 20 18:40:11.573848 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.573813    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9gtvv/must-gather-qxffn"]
Jul 20 18:40:11.574347 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.574195    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07c83d1-970d-439d-bb4a-17f3220f2e07" containerName="revoke-keys"
Jul 20 18:40:11.574347 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.574205    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07c83d1-970d-439d-bb4a-17f3220f2e07" containerName="revoke-keys"
Jul 20 18:40:11.574347 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.574230    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9" containerName="maas-api"
Jul 20 18:40:11.574347 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.574239    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9" containerName="maas-api"
Jul 20 18:40:11.574347 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.574336    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a07c83d1-970d-439d-bb4a-17f3220f2e07" containerName="revoke-keys"
Jul 20 18:40:11.574347 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.574351    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b28a0eea-655c-4e83-83e0-a9cbc0c2c5b9" containerName="maas-api"
Jul 20 18:40:11.577817 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.577797    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9gtvv/must-gather-qxffn"
Jul 20 18:40:11.580714 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.580692    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9gtvv\"/\"openshift-service-ca.crt\""
Jul 20 18:40:11.581032 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.581014    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9gtvv\"/\"kube-root-ca.crt\""
Jul 20 18:40:11.599863 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.599840    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9gtvv/must-gather-qxffn"]
Jul 20 18:40:11.617357 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.617325    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:40:11.666698 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.666659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94kc5\" (UniqueName: \"kubernetes.io/projected/f306fcc8-b169-4951-bce7-60f26507c0f0-kube-api-access-94kc5\") pod \"must-gather-qxffn\" (UID: \"f306fcc8-b169-4951-bce7-60f26507c0f0\") " pod="openshift-must-gather-9gtvv/must-gather-qxffn"
Jul 20 18:40:11.666867 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.666787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f306fcc8-b169-4951-bce7-60f26507c0f0-must-gather-output\") pod \"must-gather-qxffn\" (UID: \"f306fcc8-b169-4951-bce7-60f26507c0f0\") " pod="openshift-must-gather-9gtvv/must-gather-qxffn"
Jul 20 18:40:11.768064 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.768027    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94kc5\" (UniqueName: \"kubernetes.io/projected/f306fcc8-b169-4951-bce7-60f26507c0f0-kube-api-access-94kc5\") pod \"must-gather-qxffn\" (UID: \"f306fcc8-b169-4951-bce7-60f26507c0f0\") " pod="openshift-must-gather-9gtvv/must-gather-qxffn"
Jul 20 18:40:11.768227 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.768122    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f306fcc8-b169-4951-bce7-60f26507c0f0-must-gather-output\") pod \"must-gather-qxffn\" (UID: \"f306fcc8-b169-4951-bce7-60f26507c0f0\") " pod="openshift-must-gather-9gtvv/must-gather-qxffn"
Jul 20 18:40:11.768451 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.768435    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f306fcc8-b169-4951-bce7-60f26507c0f0-must-gather-output\") pod \"must-gather-qxffn\" (UID: \"f306fcc8-b169-4951-bce7-60f26507c0f0\") " pod="openshift-must-gather-9gtvv/must-gather-qxffn"
Jul 20 18:40:11.778154 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.778133    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94kc5\" (UniqueName: \"kubernetes.io/projected/f306fcc8-b169-4951-bce7-60f26507c0f0-kube-api-access-94kc5\") pod \"must-gather-qxffn\" (UID: \"f306fcc8-b169-4951-bce7-60f26507c0f0\") " pod="openshift-must-gather-9gtvv/must-gather-qxffn"
Jul 20 18:40:11.886089 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:11.886060    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9gtvv/must-gather-qxffn"
Jul 20 18:40:12.029822 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:12.029797    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9gtvv/must-gather-qxffn"]
Jul 20 18:40:12.032745 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:40:12.032713    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf306fcc8_b169_4951_bce7_60f26507c0f0.slice/crio-666792d7b390c7f31e95d7c0286242810882ad7bb6464acc53dac211fdfceea8 WatchSource:0}: Error finding container 666792d7b390c7f31e95d7c0286242810882ad7bb6464acc53dac211fdfceea8: Status 404 returned error can't find the container with id 666792d7b390c7f31e95d7c0286242810882ad7bb6464acc53dac211fdfceea8
Jul 20 18:40:12.738820 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:12.738776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9gtvv/must-gather-qxffn" event={"ID":"f306fcc8-b169-4951-bce7-60f26507c0f0","Type":"ContainerStarted","Data":"666792d7b390c7f31e95d7c0286242810882ad7bb6464acc53dac211fdfceea8"}
Jul 20 18:40:12.817717 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:12.817672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:40:13.749503 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:13.748625    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9gtvv/must-gather-qxffn" event={"ID":"f306fcc8-b169-4951-bce7-60f26507c0f0","Type":"ContainerStarted","Data":"c09b41f55b7658a908d8319b6e6ba27c5f028c6c71e60e296f26b5ee0a44567f"}
Jul 20 18:40:13.749503 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:13.748678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9gtvv/must-gather-qxffn" event={"ID":"f306fcc8-b169-4951-bce7-60f26507c0f0","Type":"ContainerStarted","Data":"f26992ec56cb64d3724e929918e5ea3f44c697d168e9f66bb88a61dc20cb8997"}
Jul 20 18:40:13.776783 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:13.776715    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9gtvv/must-gather-qxffn" podStartSLOduration=1.820185542 podStartE2EDuration="2.776694596s" totalImagesPullingTime="956.509054ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 18:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:40:13.77626836 +0000 UTC m=+3121.147861619" watchObservedRunningTime="2026-07-20 18:40:13.776694596 +0000 UTC m=+3121.148287856"
Jul 20 18:40:14.684544 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:14.684514    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-klwnn_b84c5ac1-f9bb-4665-b5cc-8aa55e9087d7/global-pull-secret-syncer/0.log"
Jul 20 18:40:14.870823 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:14.870789    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log"
Jul 20 18:40:15.009182 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:15.009094    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-126.ec2.internal_9e2eefae3baccec91f5e5bfac1588b9a/haproxy/0.log"
Jul 20 18:40:20.242814 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:20.242772    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-98q8f_53daaf45-ba03-4b8d-9df0-32811e35a462/kuadrant-console-plugin/0.log"
Jul 20 18:40:20.642990 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:20.642950    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qhfsq_afce5815-e25c-4021-86dd-b9d749addc50/manager/0.log"
Jul 20 18:40:22.691520 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:22.691486    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93/alertmanager/0.log"
Jul 20 18:40:22.719523 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:22.719489    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93/config-reloader/0.log"
Jul 20 18:40:22.748319 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:22.748288    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93/kube-rbac-proxy-web/0.log"
Jul 20 18:40:22.774973 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:22.774813    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93/kube-rbac-proxy/0.log"
Jul 20 18:40:22.811173 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:22.811146    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93/kube-rbac-proxy-metric/0.log"
Jul 20 18:40:22.832821 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:22.832780    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93/prom-label-proxy/0.log"
Jul 20 18:40:22.858683 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:22.858654    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee98b4f-ba89-432e-9ab6-4fa60d3b8c93/init-config-reloader/0.log"
Jul 20 18:40:22.934853 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:22.934768    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-c4f4f_19cb63a8-6e43-4cde-8074-f78547077262/cluster-monitoring-operator/0.log"
Jul 20 18:40:22.961947 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:22.961911    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-mgftb_2d708f8d-f604-4bce-9f0e-f67a102da9f6/kube-state-metrics/0.log"
Jul 20 18:40:22.986036 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:22.985997    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-mgftb_2d708f8d-f604-4bce-9f0e-f67a102da9f6/kube-rbac-proxy-main/0.log"
Jul 20 18:40:23.010755 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.010707    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-mgftb_2d708f8d-f604-4bce-9f0e-f67a102da9f6/kube-rbac-proxy-self/0.log"
Jul 20 18:40:23.041154 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.041122    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85f5756564-pjq4n_5ea2492d-d440-4127-87a8-8335f8ddf63d/metrics-server/0.log"
Jul 20 18:40:23.085603 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.085566    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-tljgm_2a664fed-c6ce-40b2-8ad0-4d0275ad56c2/monitoring-plugin/0.log"
Jul 20 18:40:23.302549 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.302468    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qvphf_e0da40e6-0634-4a7c-b7a8-14af1bd67e70/node-exporter/0.log"
Jul 20 18:40:23.336430 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.336382    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qvphf_e0da40e6-0634-4a7c-b7a8-14af1bd67e70/kube-rbac-proxy/0.log"
Jul 20 18:40:23.360826 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.360797    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qvphf_e0da40e6-0634-4a7c-b7a8-14af1bd67e70/init-textfile/0.log"
Jul 20 18:40:23.481120 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.481089    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9ce808c-85bc-4bda-b86a-11824e327a62/prometheus/0.log"
Jul 20 18:40:23.506711 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.506681    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9ce808c-85bc-4bda-b86a-11824e327a62/config-reloader/0.log"
Jul 20 18:40:23.536153 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.536114    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9ce808c-85bc-4bda-b86a-11824e327a62/thanos-sidecar/0.log"
Jul 20 18:40:23.559291 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.559151    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9ce808c-85bc-4bda-b86a-11824e327a62/kube-rbac-proxy-web/0.log"
Jul 20 18:40:23.584310 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.584282    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9ce808c-85bc-4bda-b86a-11824e327a62/kube-rbac-proxy/0.log"
Jul 20 18:40:23.609919 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.609888    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9ce808c-85bc-4bda-b86a-11824e327a62/kube-rbac-proxy-thanos/0.log"
Jul 20 18:40:23.634821 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.634795    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9ce808c-85bc-4bda-b86a-11824e327a62/init-config-reloader/0.log"
Jul 20 18:40:23.720813 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.720776    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-s4vp2_abb47825-9ddd-4164-af61-e0026f384828/prometheus-operator-admission-webhook/0.log"
Jul 20 18:40:23.753979 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.753948    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55d9d8dcd4-4bqb6_4e45d423-9b25-436f-96ea-f4af702c8974/telemeter-client/0.log"
Jul 20 18:40:23.779304 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.779274    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55d9d8dcd4-4bqb6_4e45d423-9b25-436f-96ea-f4af702c8974/reload/0.log"
Jul 20 18:40:23.806506 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.806475    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55d9d8dcd4-4bqb6_4e45d423-9b25-436f-96ea-f4af702c8974/kube-rbac-proxy/0.log"
Jul 20 18:40:23.840011 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.839982    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847db549c-kdkzx_b675c70a-ba7e-42a9-a65a-9c93b28207cf/thanos-query/0.log"
Jul 20 18:40:23.863962 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.863929    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847db549c-kdkzx_b675c70a-ba7e-42a9-a65a-9c93b28207cf/kube-rbac-proxy-web/0.log"
Jul 20 18:40:23.887940 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.887916    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847db549c-kdkzx_b675c70a-ba7e-42a9-a65a-9c93b28207cf/kube-rbac-proxy/0.log"
Jul 20 18:40:23.918402 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.918364    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847db549c-kdkzx_b675c70a-ba7e-42a9-a65a-9c93b28207cf/prom-label-proxy/0.log"
Jul 20 18:40:23.949611 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.949566    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847db549c-kdkzx_b675c70a-ba7e-42a9-a65a-9c93b28207cf/kube-rbac-proxy-rules/0.log"
Jul 20 18:40:23.982663 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:23.982630    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7847db549c-kdkzx_b675c70a-ba7e-42a9-a65a-9c93b28207cf/kube-rbac-proxy-metrics/0.log"
Jul 20 18:40:25.756142 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.756104    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"]
Jul 20 18:40:25.761183 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.761149    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.763856 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.763827    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9gtvv\"/\"default-dockercfg-knh4w\""
Jul 20 18:40:25.777162 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.777138    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"]
Jul 20 18:40:25.835125 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.835086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9qt4\" (UniqueName: \"kubernetes.io/projected/0b2075d5-0888-4d59-be2c-78ad6fa61c62-kube-api-access-x9qt4\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.835626 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.835153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-lib-modules\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.835626 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.835288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-sys\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.835626 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.835330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-podres\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.835626 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.835363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-proc\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.936654 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.936622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-sys\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.936654 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.936668    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-podres\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.936907 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.936738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-proc\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.936907 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.936773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9qt4\" (UniqueName: \"kubernetes.io/projected/0b2075d5-0888-4d59-be2c-78ad6fa61c62-kube-api-access-x9qt4\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.936907 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.936777    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-sys\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.936907 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.936846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-lib-modules\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.936907 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.936854    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-proc\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.936907 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.936892    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-podres\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.937208 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.937041    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b2075d5-0888-4d59-be2c-78ad6fa61c62-lib-modules\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:25.945472 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:25.945442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9qt4\" (UniqueName: \"kubernetes.io/projected/0b2075d5-0888-4d59-be2c-78ad6fa61c62-kube-api-access-x9qt4\") pod \"perf-node-gather-daemonset-hj994\" (UID: \"0b2075d5-0888-4d59-be2c-78ad6fa61c62\") " pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:26.074781 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:26.074691    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:26.265591 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:26.265556    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"]
Jul 20 18:40:26.269453 ip-10-0-141-126 kubenswrapper[2562]: W0720 18:40:26.269385    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0b2075d5_0888_4d59_be2c_78ad6fa61c62.slice/crio-cf079d28ed1308d6a24982f3b9158a509ce59c19141d55e15405069cf5d76feb WatchSource:0}: Error finding container cf079d28ed1308d6a24982f3b9158a509ce59c19141d55e15405069cf5d76feb: Status 404 returned error can't find the container with id cf079d28ed1308d6a24982f3b9158a509ce59c19141d55e15405069cf5d76feb
Jul 20 18:40:26.332179 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:26.332107    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54584cb785-gbqk9_3cba5d1a-8b6f-4450-a974-63eec3b89df0/console/0.log"
Jul 20 18:40:26.370437 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:26.370381    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-q8stw_72bac6e8-fe5f-4188-b3c3-e1d95fe44337/download-server/0.log"
Jul 20 18:40:26.851420 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:26.851354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994" event={"ID":"0b2075d5-0888-4d59-be2c-78ad6fa61c62","Type":"ContainerStarted","Data":"ce3af9876db1b395bf9361bcdcc3def79f1415cfd6238133cfb273ef5c80d89d"}
Jul 20 18:40:26.851900 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:26.851461    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994" event={"ID":"0b2075d5-0888-4d59-be2c-78ad6fa61c62","Type":"ContainerStarted","Data":"cf079d28ed1308d6a24982f3b9158a509ce59c19141d55e15405069cf5d76feb"}
Jul 20 18:40:26.852673 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:26.852219    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:26.874309 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:26.874238    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994" podStartSLOduration=1.8742172959999999 podStartE2EDuration="1.874217296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 18:40:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 18:40:26.871928257 +0000 UTC m=+3134.243521518" watchObservedRunningTime="2026-07-20 18:40:26.874217296 +0000 UTC m=+3134.245810556"
Jul 20 18:40:26.975086 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:26.975051    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-hwwxk_39890400-91c3-4f0c-8c4d-49dbdd9618bb/volume-data-source-validator/0.log"
Jul 20 18:40:28.034038 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:28.034007    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bcffb_0c3d3546-4f0b-48ef-9b2d-4bae9593b53f/dns/0.log"
Jul 20 18:40:28.060703 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:28.060675    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bcffb_0c3d3546-4f0b-48ef-9b2d-4bae9593b53f/kube-rbac-proxy/0.log"
Jul 20 18:40:28.266723 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:28.266697    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z4fqh_a2969127-3b92-4a1d-a54d-11a8ceb63dfe/dns-node-resolver/0.log"
Jul 20 18:40:28.895478 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:28.895443    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rzclt_b9eeb81b-2fff-4b4d-b2d3-97e3120b66d4/node-ca/0.log"
Jul 20 18:40:30.026796 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:30.026762    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b99948476-bwncd_8a2c9e70-f3ac-4853-ad63-a300f0636382/kube-auth-proxy/0.log"
Jul 20 18:40:30.204806 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:30.204775    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc67f49fb-pmswb_b4463355-2bf6-4ca6-bdcb-67dfa1131a2a/router/0.log"
Jul 20 18:40:30.930653 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:30.930626    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2clqc_db49fa4a-eacc-488f-8571-6f149475787e/serve-healthcheck-canary/0.log"
Jul 20 18:40:31.472969 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:31.472936    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-mjkfv_991597ce-1aec-4c68-9f71-6d108f9be607/insights-operator/0.log"
Jul 20 18:40:31.474347 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:31.474324    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-mjkfv_991597ce-1aec-4c68-9f71-6d108f9be607/insights-operator/1.log"
Jul 20 18:40:31.500057 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:31.500029    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2p5q8_586d71e8-311f-4934-ac72-c6fd66d24b98/kube-rbac-proxy/0.log"
Jul 20 18:40:31.528317 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:31.528293    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2p5q8_586d71e8-311f-4934-ac72-c6fd66d24b98/exporter/0.log"
Jul 20 18:40:31.558060 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:31.557989    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2p5q8_586d71e8-311f-4934-ac72-c6fd66d24b98/extractor/0.log"
Jul 20 18:40:33.875230 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:33.875153    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9gtvv/perf-node-gather-daemonset-hj994"
Jul 20 18:40:34.512057 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:34.512029    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8f8bd966-tk9zh_6465f52e-70e1-4556-a680-3cd56b964666/manager/0.log"
Jul 20 18:40:34.554331 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:34.554300    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f8f8bd966-tk9zh_6465f52e-70e1-4556-a680-3cd56b964666/copy-manifests/0.log"
Jul 20 18:40:34.876579 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:34.876552    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b99948476-bwncd_8a2c9e70-f3ac-4853-ad63-a300f0636382/kube-auth-proxy/0.log"
Jul 20 18:40:35.003110 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:35.003080    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc67f49fb-pmswb_b4463355-2bf6-4ca6-bdcb-67dfa1131a2a/router/0.log"
Jul 20 18:40:35.900274 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:35.900229    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7974845875-8cr4r_bc95a997-434f-4b38-9919-70eb844d12fc/manager/0.log"
Jul 20 18:40:36.477906 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:36.477834    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b99948476-bwncd_8a2c9e70-f3ac-4853-ad63-a300f0636382/kube-auth-proxy/0.log"
Jul 20 18:40:36.625492 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:36.625463    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-bc67f49fb-pmswb_b4463355-2bf6-4ca6-bdcb-67dfa1131a2a/router/0.log"
Jul 20 18:40:36.968048 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:36.967977    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mpmw_d6ae8fb4-a744-48e4-aebb-1dbe6db610e3/konnectivity-agent/0.log" limit=1024
Jul 20 18:40:42.459428 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:42.459381    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2grlg_b477afb8-158e-4ee9-9a0f-d21e836646b0/kube-multus-additional-cni-plugins/0.log"
Jul 20 18:40:42.486039 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:42.486016    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2grlg_b477afb8-158e-4ee9-9a0f-d21e836646b0/egress-router-binary-copy/0.log"
Jul 20 18:40:42.510603 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:42.510578    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2grlg_b477afb8-158e-4ee9-9a0f-d21e836646b0/cni-plugins/0.log"
Jul 20 18:40:42.534500 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:42.534483    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2grlg_b477afb8-158e-4ee9-9a0f-d21e836646b0/bond-cni-plugin/0.log"
Jul 20 18:40:42.560145 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:42.560124    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2grlg_b477afb8-158e-4ee9-9a0f-d21e836646b0/routeoverride-cni/0.log"
Jul 20 18:40:42.588024 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:42.587996    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2grlg_b477afb8-158e-4ee9-9a0f-d21e836646b0/whereabouts-cni-bincopy/0.log"
Jul 20 18:40:42.613450 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:42.613432    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2grlg_b477afb8-158e-4ee9-9a0f-d21e836646b0/whereabouts-cni/0.log"
Jul 20 18:40:43.252756 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:43.252726    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mhvkd_7e000655-bdbd-460d-ad3b-3e76ce9e9b81/kube-multus/0.log"
Jul 20 18:40:43.561859 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:43.561782    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vvz9s_10018892-ce37-41d3-8c3f-2e43682209fc/network-metrics-daemon/0.log"
Jul 20 18:40:43.587877 ip-10-0-141-126 kubenswrapper[2562]: I0720 18:40:43.587853    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vvz9s_10018892-ce37-41d3-8c3f-2e43682209fc/kube-rbac-proxy/0.log"