Jul 16 11:48:52.193208 ip-10-0-137-84 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 11:48:52.193223 ip-10-0-137-84 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 11:48:52.193232 ip-10-0-137-84 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 11:48:52.193692 ip-10-0-137-84 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 11:49:02.414111 ip-10-0-137-84 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 11:49:02.414128 ip-10-0-137-84 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1eac59ba7343440599667b6f67e61db5 --
Jul 16 11:50:33.569934 ip-10-0-137-84 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 11:50:34.026086 ip-10-0-137-84 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 11:50:34.026086 ip-10-0-137-84 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 11:50:34.026086 ip-10-0-137-84 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 11:50:34.026086 ip-10-0-137-84 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 11:50:34.026086 ip-10-0-137-84 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 11:50:34.026780 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.026144    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 11:50:34.032053 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032027    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:50:34.032053 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032045    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:50:34.032053 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032049    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:50:34.032053 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032055    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:50:34.032053 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032059    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:50:34.032053 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032062    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032066    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032069    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032072    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032074    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032077    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032079    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032082    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032085    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032087    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032089    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032092    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032095    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032097    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032099    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032102    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032104    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032106    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032109    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032111    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:50:34.032277 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032113    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032116    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032118    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032121    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032123    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032125    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032128    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032135    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032138    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032141    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032145    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032148    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032151    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032154    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032157    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032161    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032165    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032167    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032170    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:50:34.032810 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032172    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032175    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032177    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032180    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032182    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032185    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032187    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032190    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032192    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032195    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032197    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032200    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032203    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032205    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032208    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032210    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032212    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032215    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032217    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032220    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:50:34.033276 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032222    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032224    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032227    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032229    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032232    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032234    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032237    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032240    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032242    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032245    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032247    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032251    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032254    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032256    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032259    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032261    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032263    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032266    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032268    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032273    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:50:34.033772 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032275    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032278    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032280    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032283    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032285    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032288    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032290    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032293    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032296    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032298    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032301    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032303    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032306    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032308    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.032311    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033003    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033009    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033013    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033016    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033019    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:50:34.034243 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033021    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033024    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033027    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033030    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033032    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033035    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033037    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033040    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033042    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033045    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033047    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033050    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033054    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033056    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033059    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033061    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033063    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033066    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033068    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:50:34.034740 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033071    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033073    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033076    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033078    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033080    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033083    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033086    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033088    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033091    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033093    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033096    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033099    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033102    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033104    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033107    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033110    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033113    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033115    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033118    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033120    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:50:34.035219 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033124    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033127    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033130    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033133    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033135    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033140    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033145    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033147    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033150    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033152    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033154    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033157    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033161    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033164    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033167    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033170    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033173    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033177    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033180    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:50:34.035827 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033183    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033185    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033187    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033190    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033193    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033195    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033198    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033201    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033204    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033206    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033209    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033211    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033213    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033216    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033219    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033221    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033223    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033226    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033228    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033231    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:50:34.036284 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033234    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033236    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033240    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033242    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033245    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033247    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033250    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033252    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033254    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033257    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033261    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033263    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033266    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033268    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033271    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033273    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033655    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033661    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033663    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033666    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:50:34.036815 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033670    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033673    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033676    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033679    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033681    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033684    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033686    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033689    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033691    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033694    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033696    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033699    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033702    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033704    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033707    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033709    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033711    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033714    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033716    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033719    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:50:34.037303 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033721    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033724    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033728    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033730    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033733    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033735    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033738    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033740    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033743    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033745    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033748    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033750    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033753    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033755    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033757    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033760    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033762    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033765    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033767    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:50:34.037842 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033770    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033772    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033775    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033777    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033780    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033782    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033785    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033788    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033790    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033794    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033797    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033800    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033803    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033806    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033809    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033813    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033815    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033818    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033820    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:50:34.038296 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033823    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033825    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033828    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033831    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033833    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033835    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033838    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033840    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033843    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033845    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033847    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033850    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033852    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033854    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033857    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033859    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033861    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033864    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033866    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033869    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:50:34.038774 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033871    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033876    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033879    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033882    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033884    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033886    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033889    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033891    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033894    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033897    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033899    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033902    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033904    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033907    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033910    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033912    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.033915    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.033981    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.033988    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.033994    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.033998    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 11:50:34.039298 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034002    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034004    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034008    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034012    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034015    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034018    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034021    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034025    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034028    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034030    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034047    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034051    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034055    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034058    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034062    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034065    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034068    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034071    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034074    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034079    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034082    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034085    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034088    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034091    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 11:50:34.039823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034094    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034097    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034100    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034103    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034107    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034110    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034113    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034116    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034119    2580 flags.go:64] FLAG: --enable-server="true"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034122    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034126    2580 flags.go:64] FLAG: --event-burst="100"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034129    2580 flags.go:64] FLAG: --event-qps="50"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034132    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034135    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034137    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034141    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034143    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034146    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034149    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034152    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034154    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034158    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034161    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034163    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034166    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 11:50:34.040393 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034168    2580 flags.go:64] FLAG: --feature-gates=""
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034172    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034177    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034180    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034183    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034186    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034189    2580 flags.go:64] FLAG: --help="false"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034191    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034195    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034197    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034200    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034203    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034206    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034209    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034212    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034214    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034217    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034219    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034222    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034225    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034227    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034230    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034233    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034236    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 11:50:34.041039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034238    2580 flags.go:64] FLAG: --lock-file=""
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034241    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034243    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034246    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034251    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034255    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034257    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034260    2580 flags.go:64] FLAG: --logging-format="text"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034263    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034266    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034270    2580 flags.go:64] FLAG: --manifest-url=""
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034272    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034276    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034279    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034283    2580 flags.go:64] FLAG: --max-pods="110"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034287    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034290    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034293    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034295    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034298    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034301    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034304    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034310    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034313    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034316    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 11:50:34.041630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034318    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034321    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034326    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034328    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034331    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034334    2580 flags.go:64] FLAG: --port="10250"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034336    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034339    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-034c682ef66c2185d"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034342    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034345    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034348    2580 flags.go:64] FLAG: --register-node="true"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034350    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034354    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034357    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034359    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034362    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034365    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034369    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034372    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034375    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034378    2580 flags.go:64] FLAG: --runonce="false"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034380    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034383    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034389    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034392    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 11:50:34.042241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034394    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034397    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034400    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034403    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034405    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034408    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034411    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034413    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034416    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034419    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034421    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034426    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034429    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034431    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034435    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034438    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034441    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034443    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034446    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034449    2580 flags.go:64] FLAG: --v="2"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034452    2580 flags.go:64] FLAG: --version="false"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034457    2580 flags.go:64] FLAG: --vmodule=""
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034460    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.034463    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 11:50:34.042898 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034573    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034577    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034580    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034583    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034586    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034588    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034593    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034596    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034612    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034615    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034617    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034620    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034622    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034625    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034628    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034630    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034633    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034635    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034638    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034641    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:50:34.043487 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034643    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034647    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034651    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034654    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034656    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034659    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034661    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034664    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034666    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034670    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034674    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034677    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034681    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034683    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034686    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034688    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034691    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034693    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034697    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:50:34.043986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034699    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034703    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034706    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034709    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034712    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034715    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034718    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034720    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034723    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034725    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034727    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034730    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034733    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034735    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034738    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034741    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034744    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034747    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034749    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034752    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:50:34.044449 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034755    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034758    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034760    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034763    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034766    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034770    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034773    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034776    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034778    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034781    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034783    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034788    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034790    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034793    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034795    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034798    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034800    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034803    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034805    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034808    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:50:34.044942 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034810    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034813    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034815    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034817    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034820    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034822    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034825    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034827    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034830    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034832    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034835    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034838    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034840    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034842    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034845    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034847    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034850    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034854    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034857    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:50:34.045410 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.034859    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.036458    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.043788    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.043803    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.043822    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.043828    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043888    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043893    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043896    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043899    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043902    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043905    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043908    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043911    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043913    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:50:34.045880 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043916    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043918    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043921    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043924    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043926    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043929    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043931    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043934    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043937    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043940    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043942    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043945    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043947    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043950    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043952    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043955    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043957    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043959    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043962    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043965    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:50:34.046238 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043969    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043972    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043974    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043977    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043979    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043982    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043984    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043987    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043990    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043993    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043995    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.043998    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044000    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044003    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044005    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044007    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044011    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044015    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044018    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:50:34.046735 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044021    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044023    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044026    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044028    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044031    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044033    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044036    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044039    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044042    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044045    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044048    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044053    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044056    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044060    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044063    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044066    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044069    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044072    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044074    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:50:34.047202 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044077    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044080    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044083    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044086    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044088    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044091    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044093    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044096    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044099    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044102    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044104    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044107    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044109    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044112    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044114    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044117    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044119    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044122    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044124    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044127    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:50:34.047681 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044129    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044132    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044134    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044137    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044140    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044143    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044146    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044149    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044152    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044154    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044157    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044159    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.044164    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044296    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044300    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 11:50:34.048151 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044303    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044306    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044309    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044312    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044314    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044317    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044319    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044322    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044325    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044327    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044330    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044332    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044334    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044337    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044339    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044342    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044345    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044349    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044352    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044354    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 11:50:34.048525 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044357    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044360    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044362    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044365    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044367    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044370    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044380    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044382    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044385    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044387    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044389    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044392    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044394    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044397    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044399    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044401    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044404    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044406    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044409    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044411    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 11:50:34.049008 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044415    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044418    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044421    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044424    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044427    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044430    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044433    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044435    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044438    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044441    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044443    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044446    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044448    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044451    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044453    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044456    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044459    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044462    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044464    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 11:50:34.049485 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044472    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044475    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044477    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044480    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044482    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044485    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044488    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044490    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044492    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044495    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044497    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044499    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044502    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044504    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044507    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044509    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044512    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044514    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044517    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044519    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 11:50:34.049986 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044522    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044525    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044527    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044529    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044532    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044534    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044537    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044539    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044541    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044544    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044546    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044548    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044551    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044560    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044563    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044566    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044568    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 11:50:34.050458 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:34.044571    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 11:50:34.050871 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.044575    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 11:50:34.050871 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.044699    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 11:50:34.050871 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.047167    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 11:50:34.050871 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.048986    2580 server.go:1019] "Starting client certificate rotation"
Jul 16 11:50:34.050871 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.049095    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 11:50:34.050871 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.049150    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 11:50:34.052087 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.052069    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 11:50:34.056059 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.056036    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 11:50:34.066534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.066515    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 16 11:50:34.068919 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.068907    2580 log.go:25] "Validated CRI v1 image API"
Jul 16 11:50:34.070487 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.070468    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 11:50:34.073160 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.073143    2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9eee3bee-33dd-4972-934f-840dd62d3915:/dev/nvme0n1p3 e56279f7-16e3-4e96-b096-5ebe6984810d:/dev/nvme0n1p4]
Jul 16 11:50:34.073217 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.073161    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 11:50:34.079000 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.078873    2580 manager.go:216] Machine: {Timestamp:2026-07-16 11:50:34.077421388 +0000 UTC m=+0.380712340 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099298 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29faadd283f83428808e7b82db3148 SystemUUID:ec29faad-d283-f834-2880-8e7b82db3148 BootID:1eac59ba-7343-4405-9966-7b6f67e61db5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:79:99:c4:b5:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:79:99:c4:b5:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:cb:61:bc:81:b6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 11:50:34.079000 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.078997    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 11:50:34.079102 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.079082    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 11:50:34.080386 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.080349    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 11:50:34.080528 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.080389    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 11:50:34.081097 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.081084    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 11:50:34.081946 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.081936    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 11:50:34.081976 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.081949    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 11:50:34.081976 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.081958    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 11:50:34.082660 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.082650    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 11:50:34.084540 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.084529    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 11:50:34.089226 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.089215    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 11:50:34.089350 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.089341    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 11:50:34.089379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.089369    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 11:50:34.089405 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.089379    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 11:50:34.089405 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.089393    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 11:50:34.089405 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.089402    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 16 11:50:34.089477 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.089411    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 11:50:34.089774 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.089763    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 11:50:34.089810 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.089781    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 11:50:34.094177 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.094154    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 11:50:34.096630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.096615    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 11:50:34.096677 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.096647    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 11:50:34.096824 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.096812    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 11:50:34.096853 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.096832    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 11:50:34.096853 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.096839    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 11:50:34.096853 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.096845    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 11:50:34.096853 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.096853    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 11:50:34.096954 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.096858    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 11:50:34.097480 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.097471    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 11:50:34.097512 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.097481    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 11:50:34.097512 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.097497    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 11:50:34.097512 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.097504    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 11:50:34.097512 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.097513    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 11:50:34.097653 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.097521    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 11:50:34.098205 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.098194    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 11:50:34.098234 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.098206    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 11:50:34.099278 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.099257    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 11:50:34.099411 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.099389    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 11:50:34.101507 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.101496    2580 server.go:1268] "Started kubelet"
Jul 16 11:50:34.101668 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.101635    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 11:50:34.102348 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.102275    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 11:50:34.102424 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.102375    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 11:50:34.102480 ip-10-0-137-84 systemd[1]: Started Kubernetes Kubelet.
Jul 16 11:50:34.103797 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.103785    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 11:50:34.104142 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.104125    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 11:50:34.108241 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.108220    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 11:50:34.111286 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.111259    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 11:50:34.112367 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.111245    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-84.ec2.internal.18c2c2d7b4ef2b65  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-84.ec2.internal,UID:ip-10-0-137-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-84.ec2.internal,},FirstTimestamp:2026-07-16 11:50:34.101468005 +0000 UTC m=+0.404758955,LastTimestamp:2026-07-16 11:50:34.101468005 +0000 UTC m=+0.404758955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-84.ec2.internal,}"
Jul 16 11:50:34.112924 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.112906    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 11:50:34.113519 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.113502    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 11:50:34.113649 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.113591    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
Jul 16 11:50:34.114205 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114190    2580 factory.go:55] Registering systemd factory
Jul 16 11:50:34.114205 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114205    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 16 11:50:34.114484 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114363    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 11:50:34.114484 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114365    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 11:50:34.114484 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114388    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 11:50:34.114484 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114431    2580 factory.go:153] Registering CRI-O factory
Jul 16 11:50:34.114484 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114444    2580 factory.go:223] Registration of the crio container factory successfully
Jul 16 11:50:34.114484 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114481    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 11:50:34.114484 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114490    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 11:50:34.114808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114490    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 11:50:34.114808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114526    2580 factory.go:103] Registering Raw factory
Jul 16 11:50:34.114808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114539    2580 manager.go:1196] Started watching for new ooms in manager
Jul 16 11:50:34.114960 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.114853    2580 manager.go:349] Starting recovery of all containers
Jul 16 11:50:34.115751 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.115709    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 11:50:34.116303 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.116275    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 11:50:34.126593 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.126467    2580 manager.go:354] Recovery completed
Jul 16 11:50:34.127912 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.127892    2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 16 11:50:34.130844 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.130830    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:50:34.132815 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.132790    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:50:34.132868 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.132827    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:50:34.132868 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.132837    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:50:34.133234 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.133220    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 11:50:34.133234 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.133234    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 11:50:34.133311 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.133250    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 11:50:34.133311 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.133267    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:50:34.133980 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.133964    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:50:34.134044 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.133994    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:50:34.134044 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.134009    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:50:34.135452 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.135439    2580 policy_none.go:49] "None policy: Start"
Jul 16 11:50:34.135511 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.135459    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 11:50:34.135511 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.135470    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 11:50:34.137479 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.137466    2580 policy_none.go:47] "Start"
Jul 16 11:50:34.140424 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.140408    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-96zv9"
Jul 16 11:50:34.143347 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.143278    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-84.ec2.internal.18c2c2d7b6cd7b79  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-84.ec2.internal,UID:ip-10-0-137-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-84.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-84.ec2.internal,},FirstTimestamp:2026-07-16 11:50:34.132814713 +0000 UTC m=+0.436105663,LastTimestamp:2026-07-16 11:50:34.132814713 +0000 UTC m=+0.436105663,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-84.ec2.internal,}"
Jul 16 11:50:34.148330 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.148314    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-96zv9"
Jul 16 11:50:34.153154 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.153085    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-84.ec2.internal.18c2c2d7b6cdbe60  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-84.ec2.internal,UID:ip-10-0-137-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-84.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-84.ec2.internal,},FirstTimestamp:2026-07-16 11:50:34.13283184 +0000 UTC m=+0.436122790,LastTimestamp:2026-07-16 11:50:34.13283184 +0000 UTC m=+0.436122790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-84.ec2.internal,}"
Jul 16 11:50:34.179216 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.179201    2580 manager.go:337] "Starting Device Plugin manager"
Jul 16 11:50:34.179295 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.179241    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 11:50:34.179295 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.179251    2580 server.go:87] "Starting device plugin registration server"
Jul 16 11:50:34.179507 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.179491    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 11:50:34.179619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.179508    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 11:50:34.179766 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.179679    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 11:50:34.180284 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.179862    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 11:50:34.180284 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.179871    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 11:50:34.180394 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.180330    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 11:50:34.180394 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.180382    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-84.ec2.internal\" not found"
Jul 16 11:50:34.202985 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.202947    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 11:50:34.208573 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.204257    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 11:50:34.208573 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.204295    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 11:50:34.208573 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.204329    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 11:50:34.208573 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.204364    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 11:50:34.208573 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.206318    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:50:34.279714 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.279645    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:50:34.280808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.280792    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:50:34.280888 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.280821    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:50:34.280888 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.280832    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:50:34.280888 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.280860    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.288309 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.288295    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.288371 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.288316    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-84.ec2.internal\": node \"ip-10-0-137-84.ec2.internal\" not found"
Jul 16 11:50:34.304904 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.304886    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"]
Jul 16 11:50:34.304977 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.304942    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:50:34.307238 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.307216    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:50:34.307343 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.307250    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:50:34.307343 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.307266    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:50:34.309570 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.309559    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:50:34.309758 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.309745    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.309799 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.309785    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:50:34.310259 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.310245    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:50:34.310320 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.310270    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:50:34.310320 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.310283    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:50:34.311017 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.311001    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:50:34.311107 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.311038    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:50:34.311107 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.311054    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:50:34.313290 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.313276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.313365 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.313300    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 11:50:34.313908 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.313891    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 11:50:34.313982 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.313919    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 11:50:34.313982 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.313933    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeHasSufficientPID"
Jul 16 11:50:34.315658 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.315638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd1503b70f8d59d1be07678c53c2cba4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"cd1503b70f8d59d1be07678c53c2cba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.315704 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.315676    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd1503b70f8d59d1be07678c53c2cba4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"cd1503b70f8d59d1be07678c53c2cba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.315745 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.315704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d06eb5b4eea18a477588e034fd43842d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-84.ec2.internal\" (UID: \"d06eb5b4eea18a477588e034fd43842d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.319392 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.319378    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
Jul 16 11:50:34.331125 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.331108    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-84.ec2.internal\" not found" node="ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.334951 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.334937    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-84.ec2.internal\" not found" node="ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.416480 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.416449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d06eb5b4eea18a477588e034fd43842d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-84.ec2.internal\" (UID: \"d06eb5b4eea18a477588e034fd43842d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.416624 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.416488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd1503b70f8d59d1be07678c53c2cba4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"cd1503b70f8d59d1be07678c53c2cba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.416624 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.416513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd1503b70f8d59d1be07678c53c2cba4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"cd1503b70f8d59d1be07678c53c2cba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.416624 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.416548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d06eb5b4eea18a477588e034fd43842d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-84.ec2.internal\" (UID: \"d06eb5b4eea18a477588e034fd43842d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.416624 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.416563    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd1503b70f8d59d1be07678c53c2cba4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"cd1503b70f8d59d1be07678c53c2cba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.416624 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.416571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd1503b70f8d59d1be07678c53c2cba4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal\" (UID: \"cd1503b70f8d59d1be07678c53c2cba4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.419576 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.419561    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
Jul 16 11:50:34.520048 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.520028    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
Jul 16 11:50:34.620832 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.620768    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
Jul 16 11:50:34.633942 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.633925    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.639513 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.639241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:34.720894 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.720869    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
Jul 16 11:50:34.821430 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.821404    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
Jul 16 11:50:34.921981 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:34.921904    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-84.ec2.internal\" not found"
Jul 16 11:50:34.960411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:34.960388    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:50:35.014562 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.014537    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:35.029044 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.029023    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 11:50:35.031200 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.031187    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal"
Jul 16 11:50:35.040746 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.040727    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 11:50:35.047865 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.047850    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 11:50:35.047967 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.047948    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 11:50:35.090429 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.090403    2580 apiserver.go:52] "Watching apiserver"
Jul 16 11:50:35.100376 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.100356    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 11:50:35.100741 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.100721    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp","openshift-cluster-node-tuning-operator/tuned-8r985","openshift-image-registry/node-ca-qmqbw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal","openshift-multus/multus-sp2t5","openshift-dns/node-resolver-59grq","openshift-multus/multus-additional-cni-plugins-zk7ff","openshift-multus/network-metrics-daemon-q5nkv","openshift-network-diagnostics/network-check-target-8kbvl","openshift-network-operator/iptables-alerter-lgdnc","openshift-ovn-kubernetes/ovnkube-node-8hj7s","kube-system/global-pull-secret-syncer-8swn6","kube-system/konnectivity-agent-hdttm"]
Jul 16 11:50:35.103323 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.103303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59grq"
Jul 16 11:50:35.105377 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.105357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lgdnc"
Jul 16 11:50:35.105697 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.105680    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 11:50:35.105847 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.105830    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5pm9d\""
Jul 16 11:50:35.105918 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.105835    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 11:50:35.107571 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.107552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.107833 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.107668    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 11:50:35.107833 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.107704    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8mn8n\""
Jul 16 11:50:35.107833 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.107713    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 11:50:35.107833 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.107671    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:50:35.109748 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.109735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qmqbw"
Jul 16 11:50:35.110179 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.110162    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 11:50:35.110179 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.110169    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p5j8l\""
Jul 16 11:50:35.110302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.110170    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:50:35.112284 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.112268    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 11:50:35.112374 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.112268    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 11:50:35.112374 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.112275    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rjtcr\""
Jul 16 11:50:35.112498 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.112484    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 11:50:35.112594 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.112579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:50:35.113701 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.113685    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 11:50:35.114790 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.114768    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.114878 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.114829    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gmzbz\""
Jul 16 11:50:35.115781 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.115663    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 11:50:35.117452 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.115976    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 11:50:35.117452 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.117084    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-478lj\""
Jul 16 11:50:35.117452 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.117361    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 11:50:35.117452 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.117378    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 11:50:35.117940 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.117923    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 11:50:35.118349 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.118333    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 11:50:35.118494 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.118480    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:35.118576 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.118554    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:35.119752 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-systemd\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.119857 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1e96ed3-a442-4fda-86d2-941930181f1c-tmp\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.119857 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119793    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92fa8300-ff78-4723-a701-d94ed3a1600d-host\") pod \"node-ca-qmqbw\" (UID: \"92fa8300-ff78-4723-a701-d94ed3a1600d\") " pod="openshift-image-registry/node-ca-qmqbw"
Jul 16 11:50:35.119857 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jp4v\" (UniqueName: \"kubernetes.io/projected/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-kube-api-access-6jp4v\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.119857 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8ba25d2-3518-4fc7-b87f-e5d0426a70e8-tmp-dir\") pod \"node-resolver-59grq\" (UID: \"c8ba25d2-3518-4fc7-b87f-e5d0426a70e8\") " pod="openshift-dns/node-resolver-59grq"
Jul 16 11:50:35.119857 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94q7f\" (UniqueName: \"kubernetes.io/projected/0b8928b7-0f87-417c-9fea-4c850648a90e-kube-api-access-94q7f\") pod \"iptables-alerter-lgdnc\" (UID: \"0b8928b7-0f87-417c-9fea-4c850648a90e\") " pod="openshift-network-operator/iptables-alerter-lgdnc"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92fa8300-ff78-4723-a701-d94ed3a1600d-serviceca\") pod \"node-ca-qmqbw\" (UID: \"92fa8300-ff78-4723-a701-d94ed3a1600d\") " pod="openshift-image-registry/node-ca-qmqbw"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlmbn\" (UniqueName: \"kubernetes.io/projected/92fa8300-ff78-4723-a701-d94ed3a1600d-kube-api-access-zlmbn\") pod \"node-ca-qmqbw\" (UID: \"92fa8300-ff78-4723-a701-d94ed3a1600d\") " pod="openshift-image-registry/node-ca-qmqbw"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119914    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-run-multus-certs\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-host\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119952    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-tuned\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5vwb\" (UniqueName: \"kubernetes.io/projected/e1e96ed3-a442-4fda-86d2-941930181f1c-kube-api-access-s5vwb\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.119997    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-run-netns\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-sysctl-d\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-var-lib-kubelet\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25d6c4f3-c620-4017-817f-6d9981590b2a-konnectivity-ca\") pod \"konnectivity-agent-hdttm\" (UID: \"25d6c4f3-c620-4017-817f-6d9981590b2a\") " pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-os-release\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-cni-binary-copy\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b8928b7-0f87-417c-9fea-4c850648a90e-iptables-alerter-script\") pod \"iptables-alerter-lgdnc\" (UID: \"0b8928b7-0f87-417c-9fea-4c850648a90e\") " pod="openshift-network-operator/iptables-alerter-lgdnc"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-cnibin\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120137    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-var-lib-cni-multus\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-var-lib-kubelet\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.120281 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-conf-dir\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b8928b7-0f87-417c-9fea-4c850648a90e-host-slash\") pod \"iptables-alerter-lgdnc\" (UID: \"0b8928b7-0f87-417c-9fea-4c850648a90e\") " pod="openshift-network-operator/iptables-alerter-lgdnc"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-modprobe-d\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-sysconfig\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120248    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-run\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25d6c4f3-c620-4017-817f-6d9981590b2a-agent-certs\") pod \"konnectivity-agent-hdttm\" (UID: \"25d6c4f3-c620-4017-817f-6d9981590b2a\") " pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-system-cni-dir\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-var-lib-cni-bin\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120316    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-hostroot\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-etc-kubernetes\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-kubernetes\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120378    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-sys\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-lib-modules\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-run-k8s-cni-cncf-io\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-daemon-config\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8ba25d2-3518-4fc7-b87f-e5d0426a70e8-hosts-file\") pod \"node-resolver-59grq\" (UID: \"c8ba25d2-3518-4fc7-b87f-e5d0426a70e8\") " pod="openshift-dns/node-resolver-59grq"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpx4p\" (UniqueName: \"kubernetes.io/projected/c8ba25d2-3518-4fc7-b87f-e5d0426a70e8-kube-api-access-rpx4p\") pod \"node-resolver-59grq\" (UID: \"c8ba25d2-3518-4fc7-b87f-e5d0426a70e8\") " pod="openshift-dns/node-resolver-59grq"
Jul 16 11:50:35.121023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-sysctl-conf\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.121788 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-cni-dir\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.121788 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-socket-dir-parent\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.121788 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.120806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:35.121788 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.120871    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:35.123259 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.122985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.125463 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.125446    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:35.125545 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.125525    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:35.125646 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.125625    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 11:50:35.125713 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.125701    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 11:50:35.126253 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.126238    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 11:50:35.127717 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.127701    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.130152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.130130    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 11:50:35.130152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.130130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.130472 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.130331    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-phcc5\""
Jul 16 11:50:35.130472 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.130451    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 11:50:35.133787 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.133767    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 11:50:35.134019 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.134007    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 11:50:35.134164 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.134148    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 11:50:35.137047 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.137031    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zkfwc\""
Jul 16 11:50:35.137047 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.137031    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 11:50:35.137175 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.137034    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vx7sq\""
Jul 16 11:50:35.137253 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.137239    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 11:50:35.137507 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.137492    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 11:50:35.144925 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.144909    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 11:50:35.152920 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.152870    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 11:45:35 +0000 UTC" deadline="2028-02-05 07:23:25.502399214 +0000 UTC"
Jul 16 11:50:35.152920 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.152915    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13651h32m50.349486089s"
Jul 16 11:50:35.196613 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.196574    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6q6jx"
Jul 16 11:50:35.203337 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.203319    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6q6jx"
Jul 16 11:50:35.215197 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.215179    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 11:50:35.221119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-run-k8s-cni-cncf-io\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.221119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-daemon-config\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.221119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-run-k8s-cni-cncf-io\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.221119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221104    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpx4p\" (UniqueName: \"kubernetes.io/projected/c8ba25d2-3518-4fc7-b87f-e5d0426a70e8-kube-api-access-rpx4p\") pod \"node-resolver-59grq\" (UID: \"c8ba25d2-3518-4fc7-b87f-e5d0426a70e8\") " pod="openshift-dns/node-resolver-59grq"
Jul 16 11:50:35.221119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.221119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221204    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-var-lib-openvswitch\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.221119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-cni-dir\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.221119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nhjk\" (UniqueName: \"kubernetes.io/projected/174188b1-2017-4842-aa97-2aca4c7af98d-kube-api-access-6nhjk\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:35.221119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-registration-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.221119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-cni-dir\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.222200 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-daemon-config\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.222200 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221828    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.222200 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221867    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.222200 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d55579c7-626e-4858-bdce-fa26629700a6-ovnkube-config\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.222200 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1e96ed3-a442-4fda-86d2-941930181f1c-tmp\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.222200 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jp4v\" (UniqueName: \"kubernetes.io/projected/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-kube-api-access-6jp4v\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.222200 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.221989    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-sys-fs\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.222200 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d55579c7-626e-4858-bdce-fa26629700a6-env-overrides\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.222200 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-845rb\" (UniqueName: \"kubernetes.io/projected/d55579c7-626e-4858-bdce-fa26629700a6-kube-api-access-845rb\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.222200 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hfkw\" (UniqueName: \"kubernetes.io/projected/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-kube-api-access-5hfkw\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.222796 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222281    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 11:50:35.222796 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e3c9044-23ff-4715-9698-5c48915a00fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.222796 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-host\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.222796 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-cnibin\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.222796 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-os-release\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.222796 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-log-socket\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.222796 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-cni-bin\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.222796 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b8928b7-0f87-417c-9fea-4c850648a90e-iptables-alerter-script\") pod \"iptables-alerter-lgdnc\" (UID: \"0b8928b7-0f87-417c-9fea-4c850648a90e\") " pod="openshift-network-operator/iptables-alerter-lgdnc"
Jul 16 11:50:35.222796 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e3c9044-23ff-4715-9698-5c48915a00fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.222796 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222707    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-kubelet\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.222796 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-host\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.223152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-etc-openvswitch\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.223152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-run-openvswitch\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.223152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-run-ovn\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.223152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-cnibin\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.223152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.222975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-var-lib-cni-multus\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.223152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223005    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-var-lib-kubelet\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.223152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d55579c7-626e-4858-bdce-fa26629700a6-ovn-node-metrics-cert\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.223152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:35.223152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-modprobe-d\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.223411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-run\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.223411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b8928b7-0f87-417c-9fea-4c850648a90e-iptables-alerter-script\") pod \"iptables-alerter-lgdnc\" (UID: \"0b8928b7-0f87-417c-9fea-4c850648a90e\") " pod="openshift-network-operator/iptables-alerter-lgdnc"
Jul 16 11:50:35.223411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-var-lib-cni-bin\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.223411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-run\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.223411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-hostroot\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.223411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-cni-netd\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.223411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-hostroot\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.223411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-kubernetes\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.223411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-sys\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.223411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-cnibin\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-var-lib-cni-bin\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8ba25d2-3518-4fc7-b87f-e5d0426a70e8-hosts-file\") pod \"node-resolver-59grq\" (UID: \"c8ba25d2-3518-4fc7-b87f-e5d0426a70e8\") " pod="openshift-dns/node-resolver-59grq"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zww7\" (UniqueName: \"kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7\") pod \"network-check-target-8kbvl\" (UID: \"f34b5b00-c714-4502-819a-e05d23b9791c\") " pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-kubernetes\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e3c9044-23ff-4715-9698-5c48915a00fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-var-lib-cni-multus\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-sysctl-conf\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-socket-dir-parent\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223584    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-sys\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-system-cni-dir\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223712    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-sysctl-conf\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-systemd\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223771    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-socket-dir-parent\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92fa8300-ff78-4723-a701-d94ed3a1600d-host\") pod \"node-ca-qmqbw\" (UID: \"92fa8300-ff78-4723-a701-d94ed3a1600d\") " pod="openshift-image-registry/node-ca-qmqbw"
Jul 16 11:50:35.223863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-modprobe-d\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8ba25d2-3518-4fc7-b87f-e5d0426a70e8-tmp-dir\") pod \"node-resolver-59grq\" (UID: \"c8ba25d2-3518-4fc7-b87f-e5d0426a70e8\") " pod="openshift-dns/node-resolver-59grq"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94q7f\" (UniqueName: \"kubernetes.io/projected/0b8928b7-0f87-417c-9fea-4c850648a90e-kube-api-access-94q7f\") pod \"iptables-alerter-lgdnc\" (UID: \"0b8928b7-0f87-417c-9fea-4c850648a90e\") " pod="openshift-network-operator/iptables-alerter-lgdnc"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223960    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92fa8300-ff78-4723-a701-d94ed3a1600d-serviceca\") pod \"node-ca-qmqbw\" (UID: \"92fa8300-ff78-4723-a701-d94ed3a1600d\") " pod="openshift-image-registry/node-ca-qmqbw"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.223986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlmbn\" (UniqueName: \"kubernetes.io/projected/92fa8300-ff78-4723-a701-d94ed3a1600d-kube-api-access-zlmbn\") pod \"node-ca-qmqbw\" (UID: \"92fa8300-ff78-4723-a701-d94ed3a1600d\") " pod="openshift-image-registry/node-ca-qmqbw"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-run-multus-certs\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-device-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdbmm\" (UniqueName: \"kubernetes.io/projected/0e3c9044-23ff-4715-9698-5c48915a00fd-kube-api-access-zdbmm\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-systemd-units\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8ba25d2-3518-4fc7-b87f-e5d0426a70e8-tmp-dir\") pod \"node-resolver-59grq\" (UID: \"c8ba25d2-3518-4fc7-b87f-e5d0426a70e8\") " pod="openshift-dns/node-resolver-59grq"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-slash\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-tuned\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5vwb\" (UniqueName: \"kubernetes.io/projected/e1e96ed3-a442-4fda-86d2-941930181f1c-kube-api-access-s5vwb\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-run-netns\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224337    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-run-systemd\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-node-log\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-sysctl-d\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.224808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-var-lib-kubelet\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-run-multus-certs\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25d6c4f3-c620-4017-817f-6d9981590b2a-konnectivity-ca\") pod \"konnectivity-agent-hdttm\" (UID: \"25d6c4f3-c620-4017-817f-6d9981590b2a\") " pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-os-release\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-cni-binary-copy\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-conf-dir\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b8928b7-0f87-417c-9fea-4c850648a90e-host-slash\") pod \"iptables-alerter-lgdnc\" (UID: \"0b8928b7-0f87-417c-9fea-4c850648a90e\") " pod="openshift-network-operator/iptables-alerter-lgdnc"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40150948-2c25-4688-af04-4bb1b4f5518d-dbus\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-socket-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-sysconfig\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25d6c4f3-c620-4017-817f-6d9981590b2a-agent-certs\") pod \"konnectivity-agent-hdttm\" (UID: \"25d6c4f3-c620-4017-817f-6d9981590b2a\") " pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-system-cni-dir\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.224992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-etc-kubernetes\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-run-netns\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d55579c7-626e-4858-bdce-fa26629700a6-ovnkube-script-lib\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-system-cni-dir\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225167    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40150948-2c25-4688-af04-4bb1b4f5518d-kubelet-config\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-cni-binary-copy\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.225619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-etc-kubernetes\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.226427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225278    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-sysconfig\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.226427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.226427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225433    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b8928b7-0f87-417c-9fea-4c850648a90e-host-slash\") pod \"iptables-alerter-lgdnc\" (UID: \"0b8928b7-0f87-417c-9fea-4c850648a90e\") " pod="openshift-network-operator/iptables-alerter-lgdnc"
Jul 16 11:50:35.226427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-os-release\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.226427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-sysctl-d\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.226427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225390    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-var-lib-kubelet\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.226427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-var-lib-kubelet\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.226427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92fa8300-ff78-4723-a701-d94ed3a1600d-host\") pod \"node-ca-qmqbw\" (UID: \"92fa8300-ff78-4723-a701-d94ed3a1600d\") " pod="openshift-image-registry/node-ca-qmqbw"
Jul 16 11:50:35.226427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.225966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-host-run-netns\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.226427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.226018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-systemd\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.226427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.226066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8ba25d2-3518-4fc7-b87f-e5d0426a70e8-hosts-file\") pod \"node-resolver-59grq\" (UID: \"c8ba25d2-3518-4fc7-b87f-e5d0426a70e8\") " pod="openshift-dns/node-resolver-59grq"
Jul 16 11:50:35.226972 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.226472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92fa8300-ff78-4723-a701-d94ed3a1600d-serviceca\") pod \"node-ca-qmqbw\" (UID: \"92fa8300-ff78-4723-a701-d94ed3a1600d\") " pod="openshift-image-registry/node-ca-qmqbw"
Jul 16 11:50:35.226972 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.226529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-multus-conf-dir\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.226972 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.226578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-lib-modules\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.226972 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.226708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25d6c4f3-c620-4017-817f-6d9981590b2a-konnectivity-ca\") pod \"konnectivity-agent-hdttm\" (UID: \"25d6c4f3-c620-4017-817f-6d9981590b2a\") " pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:50:35.226972 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.226877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1e96ed3-a442-4fda-86d2-941930181f1c-lib-modules\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.227521 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.227503    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1e96ed3-a442-4fda-86d2-941930181f1c-etc-tuned\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.227655 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.227629    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1e96ed3-a442-4fda-86d2-941930181f1c-tmp\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.229832 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.229811    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25d6c4f3-c620-4017-817f-6d9981590b2a-agent-certs\") pod \"konnectivity-agent-hdttm\" (UID: \"25d6c4f3-c620-4017-817f-6d9981590b2a\") " pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:50:35.230807 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.230742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpx4p\" (UniqueName: \"kubernetes.io/projected/c8ba25d2-3518-4fc7-b87f-e5d0426a70e8-kube-api-access-rpx4p\") pod \"node-resolver-59grq\" (UID: \"c8ba25d2-3518-4fc7-b87f-e5d0426a70e8\") " pod="openshift-dns/node-resolver-59grq"
Jul 16 11:50:35.231502 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.231475    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jp4v\" (UniqueName: \"kubernetes.io/projected/3856eb1f-a4be-47ae-9b83-b3b04fa6fe86-kube-api-access-6jp4v\") pod \"multus-sp2t5\" (UID: \"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86\") " pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.232479 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.232458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlmbn\" (UniqueName: \"kubernetes.io/projected/92fa8300-ff78-4723-a701-d94ed3a1600d-kube-api-access-zlmbn\") pod \"node-ca-qmqbw\" (UID: \"92fa8300-ff78-4723-a701-d94ed3a1600d\") " pod="openshift-image-registry/node-ca-qmqbw"
Jul 16 11:50:35.232799 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.232782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94q7f\" (UniqueName: \"kubernetes.io/projected/0b8928b7-0f87-417c-9fea-4c850648a90e-kube-api-access-94q7f\") pod \"iptables-alerter-lgdnc\" (UID: \"0b8928b7-0f87-417c-9fea-4c850648a90e\") " pod="openshift-network-operator/iptables-alerter-lgdnc"
Jul 16 11:50:35.233399 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.233382    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5vwb\" (UniqueName: \"kubernetes.io/projected/e1e96ed3-a442-4fda-86d2-941930181f1c-kube-api-access-s5vwb\") pod \"tuned-8r985\" (UID: \"e1e96ed3-a442-4fda-86d2-941930181f1c\") " pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.255966 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.255943    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:50:35.298282 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:35.298250    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06eb5b4eea18a477588e034fd43842d.slice/crio-199d387fafbd947ebbc01424bf8e662bfb8a20d6775557799bbd7e864db3a468 WatchSource:0}: Error finding container 199d387fafbd947ebbc01424bf8e662bfb8a20d6775557799bbd7e864db3a468: Status 404 returned error can't find the container with id 199d387fafbd947ebbc01424bf8e662bfb8a20d6775557799bbd7e864db3a468
Jul 16 11:50:35.303076 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.303062    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 11:50:35.327390 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:35.327390 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-cni-netd\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.327562 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zww7\" (UniqueName: \"kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7\") pod \"network-check-target-8kbvl\" (UID: \"f34b5b00-c714-4502-819a-e05d23b9791c\") " pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:35.327562 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e3c9044-23ff-4715-9698-5c48915a00fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.327562 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:35.327562 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-system-cni-dir\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.327562 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327475    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-cni-netd\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.327562 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.327562 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327533    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.327562 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327538    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-device-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.327562 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.327553    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:35.327562 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.327553    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-system-cni-dir\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbmm\" (UniqueName: \"kubernetes.io/projected/0e3c9044-23ff-4715-9698-5c48915a00fd-kube-api-access-zdbmm\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.327659    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs podName:174188b1-2017-4842-aa97-2aca4c7af98d nodeName:}" failed. No retries permitted until 2026-07-16 11:50:35.827595681 +0000 UTC m=+2.130886635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs") pod "network-metrics-daemon-q5nkv" (UID: "174188b1-2017-4842-aa97-2aca4c7af98d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327678    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-device-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.327696    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret podName:40150948-2c25-4688-af04-4bb1b4f5518d nodeName:}" failed. No retries permitted until 2026-07-16 11:50:35.82768467 +0000 UTC m=+2.130975608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret") pod "global-pull-secret-syncer-8swn6" (UID: "40150948-2c25-4688-af04-4bb1b4f5518d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-systemd-units\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-slash\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-run-systemd\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-run-systemd\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-systemd-units\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-node-log\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-slash\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40150948-2c25-4688-af04-4bb1b4f5518d-dbus\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-socket-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-node-log\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-run-netns\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-socket-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.327972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d55579c7-626e-4858-bdce-fa26629700a6-ovnkube-script-lib\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40150948-2c25-4688-af04-4bb1b4f5518d-kubelet-config\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40150948-2c25-4688-af04-4bb1b4f5518d-dbus\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-run-netns\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328040    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-var-lib-openvswitch\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40150948-2c25-4688-af04-4bb1b4f5518d-kubelet-config\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nhjk\" (UniqueName: \"kubernetes.io/projected/174188b1-2017-4842-aa97-2aca4c7af98d-kube-api-access-6nhjk\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-var-lib-openvswitch\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-registration-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328150    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-registration-dir\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.328929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d55579c7-626e-4858-bdce-fa26629700a6-ovnkube-config\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-sys-fs\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-etc-selinux\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328244    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d55579c7-626e-4858-bdce-fa26629700a6-env-overrides\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328279    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-sys-fs\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-845rb\" (UniqueName: \"kubernetes.io/projected/d55579c7-626e-4858-bdce-fa26629700a6-kube-api-access-845rb\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hfkw\" (UniqueName: \"kubernetes.io/projected/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-kube-api-access-5hfkw\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e3c9044-23ff-4715-9698-5c48915a00fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-cnibin\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-os-release\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-log-socket\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328569    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-cnibin\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-cni-bin\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e3c9044-23ff-4715-9698-5c48915a00fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d55579c7-626e-4858-bdce-fa26629700a6-ovnkube-script-lib\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.329499 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-kubelet\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-etc-openvswitch\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d55579c7-626e-4858-bdce-fa26629700a6-env-overrides\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328682    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-log-socket\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-run-openvswitch\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-cni-bin\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-run-ovn\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e3c9044-23ff-4715-9698-5c48915a00fd-os-release\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-run-openvswitch\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-etc-openvswitch\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-host-kubelet\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d55579c7-626e-4858-bdce-fa26629700a6-ovn-node-metrics-cert\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328757    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d55579c7-626e-4858-bdce-fa26629700a6-run-ovn\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.328716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d55579c7-626e-4858-bdce-fa26629700a6-ovnkube-config\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.329364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e3c9044-23ff-4715-9698-5c48915a00fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.329372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e3c9044-23ff-4715-9698-5c48915a00fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.330034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.329412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e3c9044-23ff-4715-9698-5c48915a00fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.330947 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.330924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d55579c7-626e-4858-bdce-fa26629700a6-ovn-node-metrics-cert\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.333893 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.333877    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:50:35.333954 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.333901    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:50:35.333954 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.333911    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9zww7 for pod openshift-network-diagnostics/network-check-target-8kbvl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:35.334019 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.333958    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7 podName:f34b5b00-c714-4502-819a-e05d23b9791c nodeName:}" failed. No retries permitted until 2026-07-16 11:50:35.833940816 +0000 UTC m=+2.137231755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9zww7" (UniqueName: "kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7") pod "network-check-target-8kbvl" (UID: "f34b5b00-c714-4502-819a-e05d23b9791c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:35.336328 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.336313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nhjk\" (UniqueName: \"kubernetes.io/projected/174188b1-2017-4842-aa97-2aca4c7af98d-kube-api-access-6nhjk\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:35.336444 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.336428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdbmm\" (UniqueName: \"kubernetes.io/projected/0e3c9044-23ff-4715-9698-5c48915a00fd-kube-api-access-zdbmm\") pod \"multus-additional-cni-plugins-zk7ff\" (UID: \"0e3c9044-23ff-4715-9698-5c48915a00fd\") " pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.339378 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.339362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-845rb\" (UniqueName: \"kubernetes.io/projected/d55579c7-626e-4858-bdce-fa26629700a6-kube-api-access-845rb\") pod \"ovnkube-node-8hj7s\" (UID: \"d55579c7-626e-4858-bdce-fa26629700a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.342118 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.342101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hfkw\" (UniqueName: \"kubernetes.io/projected/d72aff43-a6bc-44dc-868d-6dcd39cba9fc-kube-api-access-5hfkw\") pod \"aws-ebs-csi-driver-node-7djfp\" (UID: \"d72aff43-a6bc-44dc-868d-6dcd39cba9fc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.427579 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.427502    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-59grq"
Jul 16 11:50:35.437637 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:35.437616    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ba25d2_3518_4fc7_b87f_e5d0426a70e8.slice/crio-7309ee720520ec47f1c0927f05c8f87599fc5ba33b41a02bac46138902e82262 WatchSource:0}: Error finding container 7309ee720520ec47f1c0927f05c8f87599fc5ba33b41a02bac46138902e82262: Status 404 returned error can't find the container with id 7309ee720520ec47f1c0927f05c8f87599fc5ba33b41a02bac46138902e82262
Jul 16 11:50:35.458198 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.458175    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lgdnc"
Jul 16 11:50:35.467203 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.467186    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8r985"
Jul 16 11:50:35.467935 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:35.467916    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b8928b7_0f87_417c_9fea_4c850648a90e.slice/crio-1690345b4860de239aeb65be33016774d807ce2c96b22057eb1e70285a9fd2fd WatchSource:0}: Error finding container 1690345b4860de239aeb65be33016774d807ce2c96b22057eb1e70285a9fd2fd: Status 404 returned error can't find the container with id 1690345b4860de239aeb65be33016774d807ce2c96b22057eb1e70285a9fd2fd
Jul 16 11:50:35.468486 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.468471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qmqbw"
Jul 16 11:50:35.476214 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:35.476195    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e96ed3_a442_4fda_86d2_941930181f1c.slice/crio-e573ab276549f122e0a8ffe5bb5f02a2a7ea2932b50c9075a5f690092963b648 WatchSource:0}: Error finding container e573ab276549f122e0a8ffe5bb5f02a2a7ea2932b50c9075a5f690092963b648: Status 404 returned error can't find the container with id e573ab276549f122e0a8ffe5bb5f02a2a7ea2932b50c9075a5f690092963b648
Jul 16 11:50:35.478826 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:35.478806    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fa8300_ff78_4723_a701_d94ed3a1600d.slice/crio-92a37781434c15b8a5e67fa84bc47b1965af4ea63605d6a5db0560d668d6f6d9 WatchSource:0}: Error finding container 92a37781434c15b8a5e67fa84bc47b1965af4ea63605d6a5db0560d668d6f6d9: Status 404 returned error can't find the container with id 92a37781434c15b8a5e67fa84bc47b1965af4ea63605d6a5db0560d668d6f6d9
Jul 16 11:50:35.490101 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.490084    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:50:35.498967 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:35.498946    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d6c4f3_c620_4017_817f_6d9981590b2a.slice/crio-9f7da4becf08cedb02101689b913401d936b352622ff50bf91ce5f9bfe9ac196 WatchSource:0}: Error finding container 9f7da4becf08cedb02101689b913401d936b352622ff50bf91ce5f9bfe9ac196: Status 404 returned error can't find the container with id 9f7da4becf08cedb02101689b913401d936b352622ff50bf91ce5f9bfe9ac196
Jul 16 11:50:35.504555 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.504535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sp2t5"
Jul 16 11:50:35.505470 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.505451    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:50:35.512286 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:35.512265    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3856eb1f_a4be_47ae_9b83_b3b04fa6fe86.slice/crio-9b7611dc402c06a373bc4396b989d6ea6e62339cc91d52d21cbb42dfaa94f249 WatchSource:0}: Error finding container 9b7611dc402c06a373bc4396b989d6ea6e62339cc91d52d21cbb42dfaa94f249: Status 404 returned error can't find the container with id 9b7611dc402c06a373bc4396b989d6ea6e62339cc91d52d21cbb42dfaa94f249
Jul 16 11:50:35.518208 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.518188    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp"
Jul 16 11:50:35.526933 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:35.526915    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72aff43_a6bc_44dc_868d_6dcd39cba9fc.slice/crio-a6ce62937b9de8b96ff965a6d3fdfd199441e231965dbc3261e1ece363523cf0 WatchSource:0}: Error finding container a6ce62937b9de8b96ff965a6d3fdfd199441e231965dbc3261e1ece363523cf0: Status 404 returned error can't find the container with id a6ce62937b9de8b96ff965a6d3fdfd199441e231965dbc3261e1ece363523cf0
Jul 16 11:50:35.541349 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.541332    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zk7ff"
Jul 16 11:50:35.544257 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.544241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:50:35.550241 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:35.550215    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e3c9044_23ff_4715_9698_5c48915a00fd.slice/crio-0e74532c208aef6c4e6c096b8bc70d24ee64f30df8082402f7920261829dc29b WatchSource:0}: Error finding container 0e74532c208aef6c4e6c096b8bc70d24ee64f30df8082402f7920261829dc29b: Status 404 returned error can't find the container with id 0e74532c208aef6c4e6c096b8bc70d24ee64f30df8082402f7920261829dc29b
Jul 16 11:50:35.553093 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:35.553069    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55579c7_626e_4858_bdce_fa26629700a6.slice/crio-957b076786b549155f1f30541d336aa0e6a28001c96f5f4cc1f8c0a9a5fefd78 WatchSource:0}: Error finding container 957b076786b549155f1f30541d336aa0e6a28001c96f5f4cc1f8c0a9a5fefd78: Status 404 returned error can't find the container with id 957b076786b549155f1f30541d336aa0e6a28001c96f5f4cc1f8c0a9a5fefd78
Jul 16 11:50:35.732321 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:50:35.732297    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1503b70f8d59d1be07678c53c2cba4.slice/crio-e8a9608abfd17cb530070a77afb8bb7c64823607a7831497a59ab157ccb87783 WatchSource:0}: Error finding container e8a9608abfd17cb530070a77afb8bb7c64823607a7831497a59ab157ccb87783: Status 404 returned error can't find the container with id e8a9608abfd17cb530070a77afb8bb7c64823607a7831497a59ab157ccb87783
Jul 16 11:50:35.832838 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.832798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:35.833012 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:35.832885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:35.833012 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.832971    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:35.833012 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.832984    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:35.833188 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.833051    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret podName:40150948-2c25-4688-af04-4bb1b4f5518d nodeName:}" failed. No retries permitted until 2026-07-16 11:50:36.833025562 +0000 UTC m=+3.136316520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret") pod "global-pull-secret-syncer-8swn6" (UID: "40150948-2c25-4688-af04-4bb1b4f5518d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:35.833188 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:35.833074    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs podName:174188b1-2017-4842-aa97-2aca4c7af98d nodeName:}" failed. No retries permitted until 2026-07-16 11:50:36.833062896 +0000 UTC m=+3.136353838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs") pod "network-metrics-daemon-q5nkv" (UID: "174188b1-2017-4842-aa97-2aca4c7af98d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:37.122822 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.122782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zww7\" (UniqueName: \"kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7\") pod \"network-check-target-8kbvl\" (UID: \"f34b5b00-c714-4502-819a-e05d23b9791c\") " pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:37.123014 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:37.122997    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:50:37.123067 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:37.123021    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:50:37.123067 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:37.123034    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9zww7 for pod openshift-network-diagnostics/network-check-target-8kbvl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:37.123144 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:37.123095    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7 podName:f34b5b00-c714-4502-819a-e05d23b9791c nodeName:}" failed. No retries permitted until 2026-07-16 11:50:38.123076861 +0000 UTC m=+3.237510117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zww7" (UniqueName: "kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7") pod "network-check-target-8kbvl" (UID: "f34b5b00-c714-4502-819a-e05d23b9791c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:37.397211 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.396915    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:37.397211 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.397011    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 11:45:36 +0000 UTC" deadline="2028-02-18 13:41:17.077062406 +0000 UTC"
Jul 16 11:50:37.397211 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:37.397051    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:37.397211 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.397063    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13969h50m39.680003429s"
Jul 16 11:50:37.411283 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.411156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hdttm" event={"ID":"25d6c4f3-c620-4017-817f-6d9981590b2a","Type":"ContainerStarted","Data":"9f7da4becf08cedb02101689b913401d936b352622ff50bf91ce5f9bfe9ac196"}
Jul 16 11:50:37.421071 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.421031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8r985" event={"ID":"e1e96ed3-a442-4fda-86d2-941930181f1c","Type":"ContainerStarted","Data":"e573ab276549f122e0a8ffe5bb5f02a2a7ea2932b50c9075a5f690092963b648"}
Jul 16 11:50:37.426732 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.426646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal" event={"ID":"d06eb5b4eea18a477588e034fd43842d","Type":"ContainerStarted","Data":"199d387fafbd947ebbc01424bf8e662bfb8a20d6775557799bbd7e864db3a468"}
Jul 16 11:50:37.430497 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.430445    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s" event={"ID":"d55579c7-626e-4858-bdce-fa26629700a6","Type":"ContainerStarted","Data":"957b076786b549155f1f30541d336aa0e6a28001c96f5f4cc1f8c0a9a5fefd78"}
Jul 16 11:50:37.435991 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.435956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp" event={"ID":"d72aff43-a6bc-44dc-868d-6dcd39cba9fc","Type":"ContainerStarted","Data":"a6ce62937b9de8b96ff965a6d3fdfd199441e231965dbc3261e1ece363523cf0"}
Jul 16 11:50:37.440105 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.440076    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qmqbw" event={"ID":"92fa8300-ff78-4723-a701-d94ed3a1600d","Type":"ContainerStarted","Data":"92a37781434c15b8a5e67fa84bc47b1965af4ea63605d6a5db0560d668d6f6d9"}
Jul 16 11:50:37.444746 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.444721    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lgdnc" event={"ID":"0b8928b7-0f87-417c-9fea-4c850648a90e","Type":"ContainerStarted","Data":"1690345b4860de239aeb65be33016774d807ce2c96b22057eb1e70285a9fd2fd"}
Jul 16 11:50:37.446584 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.446562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59grq" event={"ID":"c8ba25d2-3518-4fc7-b87f-e5d0426a70e8","Type":"ContainerStarted","Data":"7309ee720520ec47f1c0927f05c8f87599fc5ba33b41a02bac46138902e82262"}
Jul 16 11:50:37.460447 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.460400    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal" event={"ID":"cd1503b70f8d59d1be07678c53c2cba4","Type":"ContainerStarted","Data":"e8a9608abfd17cb530070a77afb8bb7c64823607a7831497a59ab157ccb87783"}
Jul 16 11:50:37.462758 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.462735    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zk7ff" event={"ID":"0e3c9044-23ff-4715-9698-5c48915a00fd","Type":"ContainerStarted","Data":"0e74532c208aef6c4e6c096b8bc70d24ee64f30df8082402f7920261829dc29b"}
Jul 16 11:50:37.466209 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.466183    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sp2t5" event={"ID":"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86","Type":"ContainerStarted","Data":"9b7611dc402c06a373bc4396b989d6ea6e62339cc91d52d21cbb42dfaa94f249"}
Jul 16 11:50:37.757805 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:37.757315    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 11:50:38.030573 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:38.030425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:38.030573 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:38.030508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:38.030763 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:38.030656    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:38.030763 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:38.030717    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret podName:40150948-2c25-4688-af04-4bb1b4f5518d nodeName:}" failed. No retries permitted until 2026-07-16 11:50:40.030698123 +0000 UTC m=+5.145131378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret") pod "global-pull-secret-syncer-8swn6" (UID: "40150948-2c25-4688-af04-4bb1b4f5518d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:38.031118 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:38.031101    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:38.031160 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:38.031151    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs podName:174188b1-2017-4842-aa97-2aca4c7af98d nodeName:}" failed. No retries permitted until 2026-07-16 11:50:40.031136961 +0000 UTC m=+5.145570218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs") pod "network-metrics-daemon-q5nkv" (UID: "174188b1-2017-4842-aa97-2aca4c7af98d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:38.131850 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:38.131591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zww7\" (UniqueName: \"kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7\") pod \"network-check-target-8kbvl\" (UID: \"f34b5b00-c714-4502-819a-e05d23b9791c\") " pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:38.131850 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:38.131793    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:50:38.131850 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:38.131821    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:50:38.131850 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:38.131835    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9zww7 for pod openshift-network-diagnostics/network-check-target-8kbvl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:38.132181 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:38.131896    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7 podName:f34b5b00-c714-4502-819a-e05d23b9791c nodeName:}" failed. No retries permitted until 2026-07-16 11:50:40.1318768 +0000 UTC m=+5.246310060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zww7" (UniqueName: "kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7") pod "network-check-target-8kbvl" (UID: "f34b5b00-c714-4502-819a-e05d23b9791c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:38.394405 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:38.394305    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:38.394658 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:38.394437    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:38.394861 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:38.394840    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:38.394956 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:38.394935    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:38.398483 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:38.398234    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 11:45:36 +0000 UTC" deadline="2028-01-25 17:33:05.840078105 +0000 UTC"
Jul 16 11:50:38.398483 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:38.398263    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13397h42m27.441818934s"
Jul 16 11:50:39.397409 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:39.396871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:39.397409 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:39.397006    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:40.047564 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:40.047534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:40.048025 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:40.047597    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:40.048025 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:40.047714    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:40.048025 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:40.047767    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret podName:40150948-2c25-4688-af04-4bb1b4f5518d nodeName:}" failed. No retries permitted until 2026-07-16 11:50:44.047744912 +0000 UTC m=+9.162178167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret") pod "global-pull-secret-syncer-8swn6" (UID: "40150948-2c25-4688-af04-4bb1b4f5518d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:40.048025 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:40.047811    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:40.048025 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:40.047832    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs podName:174188b1-2017-4842-aa97-2aca4c7af98d nodeName:}" failed. No retries permitted until 2026-07-16 11:50:44.047824748 +0000 UTC m=+9.162258001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs") pod "network-metrics-daemon-q5nkv" (UID: "174188b1-2017-4842-aa97-2aca4c7af98d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:40.148837 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:40.148800    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zww7\" (UniqueName: \"kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7\") pod \"network-check-target-8kbvl\" (UID: \"f34b5b00-c714-4502-819a-e05d23b9791c\") " pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:40.149033 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:40.149000    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:50:40.149033 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:40.149022    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:50:40.149033 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:40.149034    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9zww7 for pod openshift-network-diagnostics/network-check-target-8kbvl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:40.149238 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:40.149087    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7 podName:f34b5b00-c714-4502-819a-e05d23b9791c nodeName:}" failed. No retries permitted until 2026-07-16 11:50:44.149070819 +0000 UTC m=+9.263504079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zww7" (UniqueName: "kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7") pod "network-check-target-8kbvl" (UID: "f34b5b00-c714-4502-819a-e05d23b9791c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:40.393869 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:40.393769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:40.394019 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:40.393926    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:40.394311 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:40.394281    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:40.394425 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:40.394400    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:41.395630 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:41.395587    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:41.396112 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:41.395748    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:42.393713 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:42.393675    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:42.393893 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:42.393806    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:42.393893 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:42.393824    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:42.394025 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:42.393936    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:43.394611 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:43.394574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:43.395092 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:43.394717    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:44.083507 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:44.083353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:44.083507 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:44.083419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:44.083726 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:44.083552    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:44.083726 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:44.083552    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:44.083726 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:44.083620    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret podName:40150948-2c25-4688-af04-4bb1b4f5518d nodeName:}" failed. No retries permitted until 2026-07-16 11:50:52.083600999 +0000 UTC m=+17.198034257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret") pod "global-pull-secret-syncer-8swn6" (UID: "40150948-2c25-4688-af04-4bb1b4f5518d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:44.083726 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:44.083639    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs podName:174188b1-2017-4842-aa97-2aca4c7af98d nodeName:}" failed. No retries permitted until 2026-07-16 11:50:52.083629486 +0000 UTC m=+17.198062745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs") pod "network-metrics-daemon-q5nkv" (UID: "174188b1-2017-4842-aa97-2aca4c7af98d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:44.184292 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:44.184203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zww7\" (UniqueName: \"kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7\") pod \"network-check-target-8kbvl\" (UID: \"f34b5b00-c714-4502-819a-e05d23b9791c\") " pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:44.184502 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:44.184427    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:50:44.184577 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:44.184513    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:50:44.184577 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:44.184526    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9zww7 for pod openshift-network-diagnostics/network-check-target-8kbvl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:44.184656 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:44.184595    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7 podName:f34b5b00-c714-4502-819a-e05d23b9791c nodeName:}" failed. No retries permitted until 2026-07-16 11:50:52.184576053 +0000 UTC m=+17.299009311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zww7" (UniqueName: "kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7") pod "network-check-target-8kbvl" (UID: "f34b5b00-c714-4502-819a-e05d23b9791c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:44.393975 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:44.393933    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:44.394161 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:44.394073    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:44.394466 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:44.394440    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:44.394568 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:44.394552    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:45.394982 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:45.394944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:45.395342 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:45.395083    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:46.394035 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:46.393998    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:46.394215 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:46.394115    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:46.394526 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:46.394509    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:46.394628 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:46.394609    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:47.394131 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:47.394098    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:47.394585 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:47.394238    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:48.393343 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:48.393315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:48.393515 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:48.393409    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:48.393567 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:48.393513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:48.393630 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:48.393608    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:49.393919 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:49.393844    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:49.394320 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:49.393976    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:50.393620 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:50.393595    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:50.393814 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:50.393709    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:50.393814 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:50.393762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:50.393910 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:50.393851    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:51.394466 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:51.394436    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:51.394826 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:51.394580    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:52.145674 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:52.145641    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:52.145674 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:52.145689    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:52.145951 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:52.145800    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:52.145951 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:52.145808    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:52.145951 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:52.145855    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret podName:40150948-2c25-4688-af04-4bb1b4f5518d nodeName:}" failed. No retries permitted until 2026-07-16 11:51:08.145841993 +0000 UTC m=+33.260275248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret") pod "global-pull-secret-syncer-8swn6" (UID: "40150948-2c25-4688-af04-4bb1b4f5518d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:50:52.145951 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:52.145871    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs podName:174188b1-2017-4842-aa97-2aca4c7af98d nodeName:}" failed. No retries permitted until 2026-07-16 11:51:08.145863538 +0000 UTC m=+33.260296792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs") pod "network-metrics-daemon-q5nkv" (UID: "174188b1-2017-4842-aa97-2aca4c7af98d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:50:52.246031 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:52.245994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zww7\" (UniqueName: \"kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7\") pod \"network-check-target-8kbvl\" (UID: \"f34b5b00-c714-4502-819a-e05d23b9791c\") " pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:52.246202 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:52.246144    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:50:52.246202 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:52.246165    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:50:52.246202 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:52.246178    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9zww7 for pod openshift-network-diagnostics/network-check-target-8kbvl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:52.246352 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:52.246238    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7 podName:f34b5b00-c714-4502-819a-e05d23b9791c nodeName:}" failed. No retries permitted until 2026-07-16 11:51:08.246219274 +0000 UTC m=+33.360652541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zww7" (UniqueName: "kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7") pod "network-check-target-8kbvl" (UID: "f34b5b00-c714-4502-819a-e05d23b9791c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:50:52.393681 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:52.393650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:52.393856 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:52.393683    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:52.393856 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:52.393763    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:52.393946 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:52.393896    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:53.394486 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:53.394375    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:53.394921 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:53.394527    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:54.393421 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:54.393390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:54.393725 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:54.393451    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:54.393840 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:54.393725    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:54.393904 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:54.393834    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:55.395663 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:55.395633    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:55.396114 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:55.395768    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:56.394271 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:56.394237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:56.394442 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:56.394239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:56.394442 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:56.394359    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:56.394567 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:56.394444    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:57.394236 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:57.394201    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:57.394616 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:57.394314    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:58.393555 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.393386    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:50:58.393643 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.393399    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:50:58.393682 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:58.393645    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:50:58.393723 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:58.393688    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:50:58.528860 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.528834    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 11:50:58.529641 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.529512    2580 generic.go:356] "Generic (PLEG): container finished" podID="d55579c7-626e-4858-bdce-fa26629700a6" containerID="0f921a8599ba04db4bd33becbb535d1656fa06c5a216533d8b42fdb07301fe76" exitCode=1
Jul 16 11:50:58.529641 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.529614    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s" event={"ID":"d55579c7-626e-4858-bdce-fa26629700a6","Type":"ContainerStarted","Data":"88b79ff5b552a3541c2f721324f774693743692ddd3e4240783062747794d500"}
Jul 16 11:50:58.529757 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.529699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s" event={"ID":"d55579c7-626e-4858-bdce-fa26629700a6","Type":"ContainerDied","Data":"0f921a8599ba04db4bd33becbb535d1656fa06c5a216533d8b42fdb07301fe76"}
Jul 16 11:50:58.529899 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.529756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s" event={"ID":"d55579c7-626e-4858-bdce-fa26629700a6","Type":"ContainerStarted","Data":"a5cda12b06ed5409c299370d05091dff4dc888f0dfca90d3c3590f972a3c947b"}
Jul 16 11:50:58.533484 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.532022    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sp2t5" event={"ID":"3856eb1f-a4be-47ae-9b83-b3b04fa6fe86","Type":"ContainerStarted","Data":"453b70b321509c013f6d7ea4fccbac118a945fe5908fd11ec5b79a274e543840"}
Jul 16 11:50:58.535782 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.535752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8r985" event={"ID":"e1e96ed3-a442-4fda-86d2-941930181f1c","Type":"ContainerStarted","Data":"57f88642786825b47fccb685f6c60c6bc360c93e80cc726101456ba4aac4edc4"}
Jul 16 11:50:58.539104 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.538639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal" event={"ID":"d06eb5b4eea18a477588e034fd43842d","Type":"ContainerStarted","Data":"2426c162b557ffb339134196a81d0a112a1a5562d7a26143a6170c45f9226ff0"}
Jul 16 11:50:58.554524 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.554126    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sp2t5" podStartSLOduration=2.56459703 podStartE2EDuration="23.554106807s" totalImagesPullingTime="20.989509777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:50:58.553045145 +0000 UTC m=+23.667478422" watchObservedRunningTime="2026-07-16 11:50:58.554106807 +0000 UTC m=+23.668540084"
Jul 16 11:50:58.568850 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.568814    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-84.ec2.internal" podStartSLOduration=22.568799051 podStartE2EDuration="22.568799051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:50:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:50:58.568134672 +0000 UTC m=+23.682567947" watchObservedRunningTime="2026-07-16 11:50:58.568799051 +0000 UTC m=+23.683232327"
Jul 16 11:50:58.586304 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:58.586261    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8r985" podStartSLOduration=2.570621709 podStartE2EDuration="23.586242996s" totalImagesPullingTime="21.015621287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:50:58.585932177 +0000 UTC m=+23.700365454" watchObservedRunningTime="2026-07-16 11:50:58.586242996 +0000 UTC m=+23.700676276"
Jul 16 11:50:59.394017 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.393849    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:50:59.394160 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:50:59.394097    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:50:59.542168 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.542094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qmqbw" event={"ID":"92fa8300-ff78-4723-a701-d94ed3a1600d","Type":"ContainerStarted","Data":"b09519e6c374227a6c8982ffe67ec7517e7db5e2306a5fe9f234a7ec44e35859"}
Jul 16 11:50:59.543573 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.543544    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lgdnc" event={"ID":"0b8928b7-0f87-417c-9fea-4c850648a90e","Type":"ContainerStarted","Data":"417f8b15321092b58e8b5987f53ed7cb96ee74474cecae8a65ad6bb9602b48cd"}
Jul 16 11:50:59.544888 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.544864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-59grq" event={"ID":"c8ba25d2-3518-4fc7-b87f-e5d0426a70e8","Type":"ContainerStarted","Data":"f2e288b2ba7a7d66bd6c0c17f9b8d88b8be6463feea5034da8bc599b072a8a46"}
Jul 16 11:50:59.546213 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.546192    2580 generic.go:356] "Generic (PLEG): container finished" podID="cd1503b70f8d59d1be07678c53c2cba4" containerID="a51679e5dde5e4b93425f75b04bc8f16d725d4f913291061b642fdb6c302c866" exitCode=0
Jul 16 11:50:59.546319 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.546252    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal" event={"ID":"cd1503b70f8d59d1be07678c53c2cba4","Type":"ContainerDied","Data":"a51679e5dde5e4b93425f75b04bc8f16d725d4f913291061b642fdb6c302c866"}
Jul 16 11:50:59.547956 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.547933    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e3c9044-23ff-4715-9698-5c48915a00fd" containerID="80252b67690ae9e1b9d5c3aed8eb741b0f4f5631b1fcd1faa37f696ef64118a0" exitCode=0
Jul 16 11:50:59.548065 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.547959    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zk7ff" event={"ID":"0e3c9044-23ff-4715-9698-5c48915a00fd","Type":"ContainerDied","Data":"80252b67690ae9e1b9d5c3aed8eb741b0f4f5631b1fcd1faa37f696ef64118a0"}
Jul 16 11:50:59.549503 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.549478    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hdttm" event={"ID":"25d6c4f3-c620-4017-817f-6d9981590b2a","Type":"ContainerStarted","Data":"efa40046888ba111beb510eafe5da62ae85c148c09b893deb2f5dbe6bd591807"}
Jul 16 11:50:59.552267 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.552248    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 11:50:59.552591 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.552576    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s" event={"ID":"d55579c7-626e-4858-bdce-fa26629700a6","Type":"ContainerStarted","Data":"791da377fea0ea95b071b84e20a8afe14cdf37278f2545d8f012b6da5b538fb0"}
Jul 16 11:50:59.552664 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.552639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s" event={"ID":"d55579c7-626e-4858-bdce-fa26629700a6","Type":"ContainerStarted","Data":"843f5133b115295c91cada1eb6fbf639df5c933194bcb19c80daca3389dcde34"}
Jul 16 11:50:59.552725 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.552707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s" event={"ID":"d55579c7-626e-4858-bdce-fa26629700a6","Type":"ContainerStarted","Data":"71dbf41397fc38400e2f2e21a4bca8e3d8536d8c89e150d0de4e08f60776afb5"}
Jul 16 11:50:59.553981 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.553962    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp" event={"ID":"d72aff43-a6bc-44dc-868d-6dcd39cba9fc","Type":"ContainerStarted","Data":"2eed9d3fd06be9155da9419e4c11f7653a91e9983fda57317365f25087826ba2"}
Jul 16 11:50:59.557753 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.557720    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qmqbw" podStartSLOduration=4.0299336 podStartE2EDuration="24.557708862s" totalImagesPullingTime="20.527775262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:50:59.557374813 +0000 UTC m=+24.671808088" watchObservedRunningTime="2026-07-16 11:50:59.557708862 +0000 UTC m=+24.672142137"
Jul 16 11:50:59.594662 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.594627    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-59grq" podStartSLOduration=3.54234642 podStartE2EDuration="24.594615794s" totalImagesPullingTime="21.052269374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:50:59.571884102 +0000 UTC m=+24.686317379" watchObservedRunningTime="2026-07-16 11:50:59.594615794 +0000 UTC m=+24.709049066"
Jul 16 11:50:59.618180 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.618130    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hdttm" podStartSLOduration=12.413717711 podStartE2EDuration="24.618120199s" totalImagesPullingTime="12.204402488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:50:59.59443481 +0000 UTC m=+24.708868086" watchObservedRunningTime="2026-07-16 11:50:59.618120199 +0000 UTC m=+24.732553475"
Jul 16 11:50:59.633988 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.633950    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lgdnc" podStartSLOduration=4.095364499 podStartE2EDuration="24.633939004s" totalImagesPullingTime="20.538574505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:50:59.633769711 +0000 UTC m=+24.748202986" watchObservedRunningTime="2026-07-16 11:50:59.633939004 +0000 UTC m=+24.748372279"
Jul 16 11:50:59.832423 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:50:59.832399    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 11:51:00.385647 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:00.385542    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T11:50:59.832416557Z","UUID":"153907c9-2c36-403c-9ed7-6e0ad07fa4ca","Handler":null,"Name":"","Endpoint":""}
Jul 16 11:51:00.387363 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:00.387336    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 11:51:00.387521 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:00.387380    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 11:51:00.394239 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:00.394206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:00.394347 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:00.394327    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:51:00.394401 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:00.394377    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:51:00.394511 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:00.394476    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:51:00.559408 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:00.559372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp" event={"ID":"d72aff43-a6bc-44dc-868d-6dcd39cba9fc","Type":"ContainerStarted","Data":"9facb3d58a38a7c3dcf2fa62fb70335b87b797fb4708078cb65c50ea02cdf6e7"}
Jul 16 11:51:00.562370 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:00.562290    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal" event={"ID":"cd1503b70f8d59d1be07678c53c2cba4","Type":"ContainerStarted","Data":"79168318bdf8efe15217a360b6fdbfd0933c811883c9cd1f80628b6205dce506"}
Jul 16 11:51:00.580808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:00.580496    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-84.ec2.internal" podStartSLOduration=24.580478798 podStartE2EDuration="24.580478798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:50:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:00.579885158 +0000 UTC m=+25.694318436" watchObservedRunningTime="2026-07-16 11:51:00.580478798 +0000 UTC m=+25.694912070"
Jul 16 11:51:01.393666 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:01.393470    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:51:01.393823 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:01.393793    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:51:01.567783 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:01.567753    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 11:51:01.568206 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:01.568182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s" event={"ID":"d55579c7-626e-4858-bdce-fa26629700a6","Type":"ContainerStarted","Data":"7ff126c52955582b78d02d5e57ebe9926e6ec8718112b094d260dc7bf92d1a9f"}
Jul 16 11:51:01.570589 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:01.570565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp" event={"ID":"d72aff43-a6bc-44dc-868d-6dcd39cba9fc","Type":"ContainerStarted","Data":"054225246ec0eb078c395458dc9df24b76aadba3fbbaf3e5ca8679dfac79cdc3"}
Jul 16 11:51:01.597656 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:01.597565    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7djfp" podStartSLOduration=3.069186039 podStartE2EDuration="26.597533765s" totalImagesPullingTime="23.528347726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:01.597517682 +0000 UTC m=+26.711950952" watchObservedRunningTime="2026-07-16 11:51:01.597533765 +0000 UTC m=+26.711967038"
Jul 16 11:51:02.393688 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:02.393655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:02.393864 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:02.393662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:51:02.393864 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:02.393783    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:51:02.393864 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:02.393847    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:51:02.943528 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:02.943493    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:51:02.944119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:02.944096    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:51:03.393940 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:03.393864    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:51:03.394094 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:03.394006    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:51:03.574392 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:03.574335    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:51:03.574858 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:03.574835    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hdttm"
Jul 16 11:51:04.393785 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.393583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:04.394277 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.393583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:51:04.394277 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:04.393831    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:51:04.394277 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:04.393888    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:51:04.579334 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.579313    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 11:51:04.579757 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.579726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s" event={"ID":"d55579c7-626e-4858-bdce-fa26629700a6","Type":"ContainerStarted","Data":"13bf96a5d8df0ce924d05cc1388f679c774cb5fc76ce1ea530aad468ce71e388"}
Jul 16 11:51:04.579992 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.579966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:51:04.580086 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.580032    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:51:04.580086 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.580078    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:51:04.580171 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.580140    2580 scope.go:117] "RemoveContainer" containerID="0f921a8599ba04db4bd33becbb535d1656fa06c5a216533d8b42fdb07301fe76"
Jul 16 11:51:04.581946 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.581922    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e3c9044-23ff-4715-9698-5c48915a00fd" containerID="790a97ede947b61d9f9aaf3e8a7aff70e941af445b7f2439dcb74e896c0f2d32" exitCode=0
Jul 16 11:51:04.582098 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.581996    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zk7ff" event={"ID":"0e3c9044-23ff-4715-9698-5c48915a00fd","Type":"ContainerDied","Data":"790a97ede947b61d9f9aaf3e8a7aff70e941af445b7f2439dcb74e896c0f2d32"}
Jul 16 11:51:04.596249 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.596230    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:51:04.598619 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:04.598601    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:51:05.394821 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:05.394793    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:51:05.395294 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:05.394883    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:51:05.589726 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:05.589701    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 11:51:05.590180 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:05.590145    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s" event={"ID":"d55579c7-626e-4858-bdce-fa26629700a6","Type":"ContainerStarted","Data":"d7410c846f96ad820dc301d0bed4ffb2c7268a13f7d50599fdf9f38dde2e2319"}
Jul 16 11:51:05.618868 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:05.618819    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s" podStartSLOduration=9.291722797 podStartE2EDuration="30.618803227s" totalImagesPullingTime="21.32708043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:05.61859189 +0000 UTC m=+30.733049943" watchObservedRunningTime="2026-07-16 11:51:05.618803227 +0000 UTC m=+30.733236502"
Jul 16 11:51:05.893571 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:05.893385    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8kbvl"]
Jul 16 11:51:05.893693 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:05.893648    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:05.893744 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:05.893726    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:51:05.896506 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:05.896481    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q5nkv"]
Jul 16 11:51:05.896615 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:05.896581    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:51:05.896722 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:05.896689    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:51:05.897085 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:05.897065    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8swn6"]
Jul 16 11:51:05.897171 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:05.897138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:51:05.897217 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:05.897196    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:51:06.593841 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:06.593808    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e3c9044-23ff-4715-9698-5c48915a00fd" containerID="1f45eab7b744b5922a81d21e8cf11a49cdbd380fa351ab760db9ad96a3b3c09b" exitCode=0
Jul 16 11:51:06.594208 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:06.593864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zk7ff" event={"ID":"0e3c9044-23ff-4715-9698-5c48915a00fd","Type":"ContainerDied","Data":"1f45eab7b744b5922a81d21e8cf11a49cdbd380fa351ab760db9ad96a3b3c09b"}
Jul 16 11:51:07.393863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:07.393831    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:07.394024 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:07.393830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:51:07.394024 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:07.393936    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:51:07.394024 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:07.393830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:51:07.394178 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:07.394026    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:51:07.394178 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:07.394124    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:51:08.168112 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:08.168041    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:51:08.168112 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:08.168083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:51:08.168681 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:08.168173    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:08.168681 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:08.168179    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:08.168681 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:08.168220    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret podName:40150948-2c25-4688-af04-4bb1b4f5518d nodeName:}" failed. No retries permitted until 2026-07-16 11:51:40.168207846 +0000 UTC m=+65.282641100 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret") pod "global-pull-secret-syncer-8swn6" (UID: "40150948-2c25-4688-af04-4bb1b4f5518d") : object "kube-system"/"original-pull-secret" not registered
Jul 16 11:51:08.168681 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:08.168233    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs podName:174188b1-2017-4842-aa97-2aca4c7af98d nodeName:}" failed. No retries permitted until 2026-07-16 11:51:40.168227636 +0000 UTC m=+65.282660890 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs") pod "network-metrics-daemon-q5nkv" (UID: "174188b1-2017-4842-aa97-2aca4c7af98d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 11:51:08.268503 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:08.268476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zww7\" (UniqueName: \"kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7\") pod \"network-check-target-8kbvl\" (UID: \"f34b5b00-c714-4502-819a-e05d23b9791c\") " pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:08.268640 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:08.268584    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 11:51:08.268640 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:08.268597    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 11:51:08.268640 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:08.268606    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9zww7 for pod openshift-network-diagnostics/network-check-target-8kbvl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:08.268745 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:08.268649    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7 podName:f34b5b00-c714-4502-819a-e05d23b9791c nodeName:}" failed. No retries permitted until 2026-07-16 11:51:40.268636953 +0000 UTC m=+65.383070220 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zww7" (UniqueName: "kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7") pod "network-check-target-8kbvl" (UID: "f34b5b00-c714-4502-819a-e05d23b9791c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 11:51:09.394129 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:09.394106    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:51:09.394664 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:09.394136    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:51:09.394664 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:09.394110    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:09.394664 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:09.394229    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8swn6" podUID="40150948-2c25-4688-af04-4bb1b4f5518d"
Jul 16 11:51:09.394664 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:09.394281    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8kbvl" podUID="f34b5b00-c714-4502-819a-e05d23b9791c"
Jul 16 11:51:09.394664 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:09.394340    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q5nkv" podUID="174188b1-2017-4842-aa97-2aca4c7af98d"
Jul 16 11:51:09.602864 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:09.602796    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e3c9044-23ff-4715-9698-5c48915a00fd" containerID="b62847ebdb133df83e1b18d6b6a127bada5bb11ed4cdece6a8bb82343452bf25" exitCode=0
Jul 16 11:51:09.602864 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:09.602856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zk7ff" event={"ID":"0e3c9044-23ff-4715-9698-5c48915a00fd","Type":"ContainerDied","Data":"b62847ebdb133df83e1b18d6b6a127bada5bb11ed4cdece6a8bb82343452bf25"}
Jul 16 11:51:10.732337 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.732262    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-84.ec2.internal" event="NodeReady"
Jul 16 11:51:10.732818 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.732422    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 11:51:10.769017 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.768984    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-547b748b65-r7tmb"]
Jul 16 11:51:10.772911 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.772884    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.776299 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.775998    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 11:51:10.776299 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.776116    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 11:51:10.776502 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.776406    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pbnkd\""
Jul 16 11:51:10.776502 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.776406    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 11:51:10.782826 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.782675    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 11:51:10.786590 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.786405    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-547b748b65-r7tmb"]
Jul 16 11:51:10.805784 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.805750    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n87tk"]
Jul 16 11:51:10.808817 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.808793    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dks4s"]
Jul 16 11:51:10.808936 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.808919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:10.811296 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.811263    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 11:51:10.811296 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.811270    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 11:51:10.811487 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.811274    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b759k\""
Jul 16 11:51:10.812708 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.812689    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dks4s"
Jul 16 11:51:10.815054 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.815035    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 11:51:10.815153 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.815141    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2lz8k\""
Jul 16 11:51:10.815229 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.815213    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 11:51:10.815289 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.815230    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 11:51:10.818219 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.818196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dks4s"]
Jul 16 11:51:10.821874 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.821836    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n87tk"]
Jul 16 11:51:10.887116 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.887077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-image-registry-private-configuration\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.887308 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.887126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-registry-certificates\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.887308 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.887189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.887308 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.887219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-bound-sa-token\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.887425 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.887355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c479f8de-037a-47d2-a6ec-985422170058-ca-trust-extracted\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.887500 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.887419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-trusted-ca\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.887500 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.887452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w68l\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-kube-api-access-2w68l\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.887595 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.887526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-installation-pull-secrets\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.988503 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-bound-sa-token\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.988503 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c167e8d9-64a9-4a36-8363-40890e887794-tmp-dir\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:10.988733 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988524    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c167e8d9-64a9-4a36-8363-40890e887794-config-volume\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:10.988733 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c479f8de-037a-47d2-a6ec-985422170058-ca-trust-extracted\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.988733 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988602    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:10.988733 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988642    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ee51f50-1a16-43a0-8c51-62f57e9cb40f-cert\") pod \"ingress-canary-dks4s\" (UID: \"7ee51f50-1a16-43a0-8c51-62f57e9cb40f\") " pod="openshift-ingress-canary/ingress-canary-dks4s"
Jul 16 11:51:10.988733 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-trusted-ca\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.988733 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w68l\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-kube-api-access-2w68l\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.988981 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-installation-pull-secrets\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.988981 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6hfx\" (UniqueName: \"kubernetes.io/projected/c167e8d9-64a9-4a36-8363-40890e887794-kube-api-access-b6hfx\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:10.988981 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-image-registry-private-configuration\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.988981 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-registry-certificates\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.988981 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.988981 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drt47\" (UniqueName: \"kubernetes.io/projected/7ee51f50-1a16-43a0-8c51-62f57e9cb40f-kube-api-access-drt47\") pod \"ingress-canary-dks4s\" (UID: \"7ee51f50-1a16-43a0-8c51-62f57e9cb40f\") " pod="openshift-ingress-canary/ingress-canary-dks4s"
Jul 16 11:51:10.988981 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.988912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c479f8de-037a-47d2-a6ec-985422170058-ca-trust-extracted\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.989752 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:10.989714    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:51:10.989752 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:10.989735    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b748b65-r7tmb: secret "image-registry-tls" not found
Jul 16 11:51:10.989752 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.989747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-trusted-ca\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.990011 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:10.989793    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls podName:c479f8de-037a-47d2-a6ec-985422170058 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:11.489774932 +0000 UTC m=+36.604208203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls") pod "image-registry-547b748b65-r7tmb" (UID: "c479f8de-037a-47d2-a6ec-985422170058") : secret "image-registry-tls" not found
Jul 16 11:51:10.990011 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.989969    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-registry-certificates\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.994400 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.994381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-installation-pull-secrets\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.994581 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.994410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-image-registry-private-configuration\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.997577 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.997432    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-bound-sa-token\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:10.997653 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:10.997565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w68l\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-kube-api-access-2w68l\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:11.089788 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.089752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c167e8d9-64a9-4a36-8363-40890e887794-config-volume\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:11.089973 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.089793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:11.089973 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.089825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ee51f50-1a16-43a0-8c51-62f57e9cb40f-cert\") pod \"ingress-canary-dks4s\" (UID: \"7ee51f50-1a16-43a0-8c51-62f57e9cb40f\") " pod="openshift-ingress-canary/ingress-canary-dks4s"
Jul 16 11:51:11.089973 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.089897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6hfx\" (UniqueName: \"kubernetes.io/projected/c167e8d9-64a9-4a36-8363-40890e887794-kube-api-access-b6hfx\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:11.089973 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:11.089925    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:11.090125 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:11.089996    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls podName:c167e8d9-64a9-4a36-8363-40890e887794 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:11.589975469 +0000 UTC m=+36.704408738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls") pod "dns-default-n87tk" (UID: "c167e8d9-64a9-4a36-8363-40890e887794") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:11.090162 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.090131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drt47\" (UniqueName: \"kubernetes.io/projected/7ee51f50-1a16-43a0-8c51-62f57e9cb40f-kube-api-access-drt47\") pod \"ingress-canary-dks4s\" (UID: \"7ee51f50-1a16-43a0-8c51-62f57e9cb40f\") " pod="openshift-ingress-canary/ingress-canary-dks4s"
Jul 16 11:51:11.090197 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.090181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c167e8d9-64a9-4a36-8363-40890e887794-tmp-dir\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:11.090359 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.090336    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c167e8d9-64a9-4a36-8363-40890e887794-config-volume\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:11.090480 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.090434    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c167e8d9-64a9-4a36-8363-40890e887794-tmp-dir\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:11.092683 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.092662    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ee51f50-1a16-43a0-8c51-62f57e9cb40f-cert\") pod \"ingress-canary-dks4s\" (UID: \"7ee51f50-1a16-43a0-8c51-62f57e9cb40f\") " pod="openshift-ingress-canary/ingress-canary-dks4s"
Jul 16 11:51:11.099298 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.099254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6hfx\" (UniqueName: \"kubernetes.io/projected/c167e8d9-64a9-4a36-8363-40890e887794-kube-api-access-b6hfx\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:11.099615 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.099593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drt47\" (UniqueName: \"kubernetes.io/projected/7ee51f50-1a16-43a0-8c51-62f57e9cb40f-kube-api-access-drt47\") pod \"ingress-canary-dks4s\" (UID: \"7ee51f50-1a16-43a0-8c51-62f57e9cb40f\") " pod="openshift-ingress-canary/ingress-canary-dks4s"
Jul 16 11:51:11.130610 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.130584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dks4s"
Jul 16 11:51:11.282040 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.281944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dks4s"]
Jul 16 11:51:11.285529 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:51:11.285502    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee51f50_1a16_43a0_8c51_62f57e9cb40f.slice/crio-19d1f3a8e816214f8e97797072ef6e35021632d44335f5843df0212d2f8c6aac WatchSource:0}: Error finding container 19d1f3a8e816214f8e97797072ef6e35021632d44335f5843df0212d2f8c6aac: Status 404 returned error can't find the container with id 19d1f3a8e816214f8e97797072ef6e35021632d44335f5843df0212d2f8c6aac
Jul 16 11:51:11.393734 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.393700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:11.393880 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.393700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:51:11.394233 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.393700    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:51:11.396647 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.396436    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 11:51:11.396647 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.396478    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 11:51:11.396647 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.396520    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gtptt\""
Jul 16 11:51:11.396866 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.396765    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 11:51:11.396920 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.396869    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vn7fb\""
Jul 16 11:51:11.396999 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.396982    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 11:51:11.495031 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.495000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:11.495145 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:11.495128    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:51:11.495145 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:11.495139    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b748b65-r7tmb: secret "image-registry-tls" not found
Jul 16 11:51:11.495230 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:11.495198    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls podName:c479f8de-037a-47d2-a6ec-985422170058 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:12.495181324 +0000 UTC m=+37.609614579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls") pod "image-registry-547b748b65-r7tmb" (UID: "c479f8de-037a-47d2-a6ec-985422170058") : secret "image-registry-tls" not found
Jul 16 11:51:11.595833 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.595742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:11.595978 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:11.595938    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:11.596046 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:11.596033    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls podName:c167e8d9-64a9-4a36-8363-40890e887794 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:12.596011997 +0000 UTC m=+37.710445257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls") pod "dns-default-n87tk" (UID: "c167e8d9-64a9-4a36-8363-40890e887794") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:11.608520 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:11.608492    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dks4s" event={"ID":"7ee51f50-1a16-43a0-8c51-62f57e9cb40f","Type":"ContainerStarted","Data":"19d1f3a8e816214f8e97797072ef6e35021632d44335f5843df0212d2f8c6aac"}
Jul 16 11:51:12.502531 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:12.502488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:12.503042 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:12.502651    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:51:12.503042 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:12.502674    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b748b65-r7tmb: secret "image-registry-tls" not found
Jul 16 11:51:12.503042 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:12.502772    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls podName:c479f8de-037a-47d2-a6ec-985422170058 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:14.50275239 +0000 UTC m=+39.617185659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls") pod "image-registry-547b748b65-r7tmb" (UID: "c479f8de-037a-47d2-a6ec-985422170058") : secret "image-registry-tls" not found
Jul 16 11:51:12.603539 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:12.603498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:12.603785 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:12.603660    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:12.603785 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:12.603740    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls podName:c167e8d9-64a9-4a36-8363-40890e887794 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:14.603723157 +0000 UTC m=+39.718156431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls") pod "dns-default-n87tk" (UID: "c167e8d9-64a9-4a36-8363-40890e887794") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:12.780521 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:12.780409    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:12.927074 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:12.927037    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:13.011584 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:13.011547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:13.149825 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:13.149728    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:13.252119 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:13.252066    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:13.319998 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:13.319955    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:13.405494 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:13.405385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:13.507111 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:13.507067    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:13.891302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:13.891137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:14.285971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:14.285876    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:14.386636 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:14.386594    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:14.519504 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:14.519449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:14.519888 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:14.519603    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:51:14.519888 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:14.519620    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b748b65-r7tmb: secret "image-registry-tls" not found
Jul 16 11:51:14.519888 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:14.519683    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls podName:c479f8de-037a-47d2-a6ec-985422170058 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:18.519659337 +0000 UTC m=+43.634092618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls") pod "image-registry-547b748b65-r7tmb" (UID: "c479f8de-037a-47d2-a6ec-985422170058") : secret "image-registry-tls" not found
Jul 16 11:51:14.620033 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:14.619961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:14.620164 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:14.620067    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:14.620164 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:14.620121    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls podName:c167e8d9-64a9-4a36-8363-40890e887794 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:18.620105264 +0000 UTC m=+43.734538519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls") pod "dns-default-n87tk" (UID: "c167e8d9-64a9-4a36-8363-40890e887794") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:15.202985 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:15.202773    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:15.306363 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:15.306337    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:15.622507 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:15.622412    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e3c9044-23ff-4715-9698-5c48915a00fd" containerID="f833a6f9e0540e44276b9ee56ade05cda490c4763b946ff18679350d6d94fed3" exitCode=0
Jul 16 11:51:15.623001 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:15.622502    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zk7ff" event={"ID":"0e3c9044-23ff-4715-9698-5c48915a00fd","Type":"ContainerDied","Data":"f833a6f9e0540e44276b9ee56ade05cda490c4763b946ff18679350d6d94fed3"}
Jul 16 11:51:15.624020 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:15.623991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dks4s" event={"ID":"7ee51f50-1a16-43a0-8c51-62f57e9cb40f","Type":"ContainerStarted","Data":"6c6fd2f5b843991686bd8607b36d5a813a4742932e979e0fb828d834c2ea7aa5"}
Jul 16 11:51:15.663116 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:15.663062    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dks4s" podStartSLOduration=2.017138466 podStartE2EDuration="5.663045951s" totalImagesPullingTime="3.645907485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:15.66183556 +0000 UTC m=+40.776268838" watchObservedRunningTime="2026-07-16 11:51:15.663045951 +0000 UTC m=+40.777479226"
Jul 16 11:51:16.629113 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:16.629073    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e3c9044-23ff-4715-9698-5c48915a00fd" containerID="2cce28b2397af9a197bf1f209ae6e53ba190b52bfd113b9cad1e830bf8218cce" exitCode=0
Jul 16 11:51:16.629518 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:16.629159    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zk7ff" event={"ID":"0e3c9044-23ff-4715-9698-5c48915a00fd","Type":"ContainerDied","Data":"2cce28b2397af9a197bf1f209ae6e53ba190b52bfd113b9cad1e830bf8218cce"}
Jul 16 11:51:17.638474 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:17.638425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zk7ff" event={"ID":"0e3c9044-23ff-4715-9698-5c48915a00fd","Type":"ContainerStarted","Data":"f10b35bacb082e867dc7e10aa76a6ffe8c766242b11163396aecd422910c79e8"}
Jul 16 11:51:17.661143 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:17.661092    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zk7ff" podStartSLOduration=9.040474719 podStartE2EDuration="42.661074606s" totalImagesPullingTime="33.620599887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:17.660116479 +0000 UTC m=+42.774549754" watchObservedRunningTime="2026-07-16 11:51:17.661074606 +0000 UTC m=+42.775507885"
Jul 16 11:51:17.783035 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:17.783000    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:17.883990 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:17.883963    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:18.547522 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:18.547486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:18.547686 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:18.547633    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:51:18.547686 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:18.547653    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b748b65-r7tmb: secret "image-registry-tls" not found
Jul 16 11:51:18.547765 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:18.547710    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls podName:c479f8de-037a-47d2-a6ec-985422170058 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:26.54769535 +0000 UTC m=+51.662128604 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls") pod "image-registry-547b748b65-r7tmb" (UID: "c479f8de-037a-47d2-a6ec-985422170058") : secret "image-registry-tls" not found
Jul 16 11:51:18.648651 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:18.648621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:18.649031 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:18.648749    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:18.649031 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:18.648802    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls podName:c167e8d9-64a9-4a36-8363-40890e887794 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:26.648787955 +0000 UTC m=+51.763221208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls") pod "dns-default-n87tk" (UID: "c167e8d9-64a9-4a36-8363-40890e887794") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:20.419009 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:20.418977    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:20.480045 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:20.480007    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:22.660429 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:22.660388    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:22.719517 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:22.719484    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:23.579543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:23.579503    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:23.643101 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:23.643071    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:26.603799 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:26.603761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:26.604281 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:26.603895    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:51:26.604281 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:26.603915    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b748b65-r7tmb: secret "image-registry-tls" not found
Jul 16 11:51:26.604281 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:26.603984    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls podName:c479f8de-037a-47d2-a6ec-985422170058 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:42.603966491 +0000 UTC m=+67.718399746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls") pod "image-registry-547b748b65-r7tmb" (UID: "c479f8de-037a-47d2-a6ec-985422170058") : secret "image-registry-tls" not found
Jul 16 11:51:26.704693 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:26.704664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:26.704829 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:26.704816    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:26.704895 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:26.704881    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls podName:c167e8d9-64a9-4a36-8363-40890e887794 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:42.704863521 +0000 UTC m=+67.819296792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls") pod "dns-default-n87tk" (UID: "c167e8d9-64a9-4a36-8363-40890e887794") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:27.631233 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:27.631197    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:31.373042 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:31.372996    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:35.239704 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:35.239670    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:35.350275 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:35.350244    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:35.451142 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:35.451096    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:36.298860 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:36.298826    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:36.358690 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:36.358627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:36.607822 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:36.607736    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8hj7s"
Jul 16 11:51:36.764041 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:36.764012    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:36.863978 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:36.863894    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:38.230633 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:38.230595    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:40.200736 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.200686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:51:40.201196 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.200753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:51:40.203102 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.203076    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 11:51:40.203181 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.203164    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 11:51:40.211125 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:40.211100    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 11:51:40.211239 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:40.211210    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs podName:174188b1-2017-4842-aa97-2aca4c7af98d nodeName:}" failed. No retries permitted until 2026-07-16 11:52:44.211188876 +0000 UTC m=+129.325622141 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs") pod "network-metrics-daemon-q5nkv" (UID: "174188b1-2017-4842-aa97-2aca4c7af98d") : secret "metrics-daemon-secret" not found
Jul 16 11:51:40.214778 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.214754    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40150948-2c25-4688-af04-4bb1b4f5518d-original-pull-secret\") pod \"global-pull-secret-syncer-8swn6\" (UID: \"40150948-2c25-4688-af04-4bb1b4f5518d\") " pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:51:40.219589 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.219573    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8swn6"
Jul 16 11:51:40.258800 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.258764    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:40.302066 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.301635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zww7\" (UniqueName: \"kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7\") pod \"network-check-target-8kbvl\" (UID: \"f34b5b00-c714-4502-819a-e05d23b9791c\") " pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:40.304351 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.304324    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 11:51:40.314318 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.314295    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 11:51:40.319054 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.319023    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:40.325402 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.325372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zww7\" (UniqueName: \"kubernetes.io/projected/f34b5b00-c714-4502-819a-e05d23b9791c-kube-api-access-9zww7\") pod \"network-check-target-8kbvl\" (UID: \"f34b5b00-c714-4502-819a-e05d23b9791c\") " pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:40.358537 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.358510    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8swn6"]
Jul 16 11:51:40.362159 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:51:40.362138    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40150948_2c25_4688_af04_4bb1b4f5518d.slice/crio-edd7c73ce6b19bb003d6a37e45e4b3c5580f5887d5defb8675ab0f7b63e37ed1 WatchSource:0}: Error finding container edd7c73ce6b19bb003d6a37e45e4b3c5580f5887d5defb8675ab0f7b63e37ed1: Status 404 returned error can't find the container with id edd7c73ce6b19bb003d6a37e45e4b3c5580f5887d5defb8675ab0f7b63e37ed1
Jul 16 11:51:40.385198 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.385177    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:40.446472 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.446424    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:40.508361 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.508305    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gtptt\""
Jul 16 11:51:40.516335 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.516310    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:40.638327 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.638298    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8kbvl"]
Jul 16 11:51:40.641694 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:51:40.641661    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34b5b00_c714_4502_819a_e05d23b9791c.slice/crio-43160a432159a6ac613566bc830e271b86e27c1310ddb91b4cb67fe946d7debf WatchSource:0}: Error finding container 43160a432159a6ac613566bc830e271b86e27c1310ddb91b4cb67fe946d7debf: Status 404 returned error can't find the container with id 43160a432159a6ac613566bc830e271b86e27c1310ddb91b4cb67fe946d7debf
Jul 16 11:51:40.642626 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.642594    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:40.692656 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.692630    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8kbvl" event={"ID":"f34b5b00-c714-4502-819a-e05d23b9791c","Type":"ContainerStarted","Data":"43160a432159a6ac613566bc830e271b86e27c1310ddb91b4cb67fe946d7debf"}
Jul 16 11:51:40.693673 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.693647    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8swn6" event={"ID":"40150948-2c25-4688-af04-4bb1b4f5518d","Type":"ContainerStarted","Data":"edd7c73ce6b19bb003d6a37e45e4b3c5580f5887d5defb8675ab0f7b63e37ed1"}
Jul 16 11:51:40.709558 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:40.709529    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:42.618389 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:42.618348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:51:42.618944 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:42.618538    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 11:51:42.618944 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:42.618554    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-547b748b65-r7tmb: secret "image-registry-tls" not found
Jul 16 11:51:42.618944 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:42.618611    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls podName:c479f8de-037a-47d2-a6ec-985422170058 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:14.618591871 +0000 UTC m=+99.733025130 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls") pod "image-registry-547b748b65-r7tmb" (UID: "c479f8de-037a-47d2-a6ec-985422170058") : secret "image-registry-tls" not found
Jul 16 11:51:42.719136 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:42.719101    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:51:42.719308 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:42.719284    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 11:51:42.719381 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:42.719369    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls podName:c167e8d9-64a9-4a36-8363-40890e887794 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:14.719347683 +0000 UTC m=+99.833780955 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls") pod "dns-default-n87tk" (UID: "c167e8d9-64a9-4a36-8363-40890e887794") : secret "dns-default-metrics-tls" not found
Jul 16 11:51:42.917402 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:42.917278    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:42.989665 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:42.989632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:46.639884 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.639841    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nhjhp"]
Jul 16 11:51:46.642576 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.642552    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.648091 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.648068    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 11:51:46.648209 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.648180    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 11:51:46.648269 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.648228    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 11:51:46.648700 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.648681    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qlctg\""
Jul 16 11:51:46.648865 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.648849    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 11:51:46.663512 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.663489    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nhjhp"]
Jul 16 11:51:46.710093 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.710062    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8kbvl" event={"ID":"f34b5b00-c714-4502-819a-e05d23b9791c","Type":"ContainerStarted","Data":"30e6d02a3fd7c8c69aa71cb611509f1d8be3cdd5d0e019def34126ee1f2cc430"}
Jul 16 11:51:46.710255 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.710190    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:51:46.711706 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.711684    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8swn6" event={"ID":"40150948-2c25-4688-af04-4bb1b4f5518d","Type":"ContainerStarted","Data":"3b628411c4beffcaf06166516f39623e5b489d3ba3cad6edef7961768e427892"}
Jul 16 11:51:46.727709 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.727663    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8kbvl" podStartSLOduration=66.477203415 podStartE2EDuration="1m11.727646928s" totalImagesPullingTime="5.250443513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:46.726959311 +0000 UTC m=+71.841392587" watchObservedRunningTime="2026-07-16 11:51:46.727646928 +0000 UTC m=+71.842080203"
Jul 16 11:51:46.729330 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.729307    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:46.744936 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.744893    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8swn6" podStartSLOduration=66.212513939 podStartE2EDuration="1m11.744878725s" totalImagesPullingTime="5.532364786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:51:46.744358646 +0000 UTC m=+71.858791926" watchObservedRunningTime="2026-07-16 11:51:46.744878725 +0000 UTC m=+71.859312000"
Jul 16 11:51:46.752655 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.752627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1bcade03-751f-4323-a681-fa5bdc54e780-crio-socket\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.752719 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.752662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.752898 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.752878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.752937 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.752911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzbj8\" (UniqueName: \"kubernetes.io/projected/1bcade03-751f-4323-a681-fa5bdc54e780-kube-api-access-jzbj8\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.752982 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.752947    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bcade03-751f-4323-a681-fa5bdc54e780-data-volume\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.842601 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.842563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:46.853524 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.853499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bcade03-751f-4323-a681-fa5bdc54e780-data-volume\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.853613 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.853546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1bcade03-751f-4323-a681-fa5bdc54e780-crio-socket\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.853613 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.853568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.853703 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.853618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.853703 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.853626    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1bcade03-751f-4323-a681-fa5bdc54e780-crio-socket\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.853703 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.853639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzbj8\" (UniqueName: \"kubernetes.io/projected/1bcade03-751f-4323-a681-fa5bdc54e780-kube-api-access-jzbj8\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.853847 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:46.853712    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:51:46.853847 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:46.853751    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:46.853847 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:46.853786    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm podName:1bcade03-751f-4323-a681-fa5bdc54e780 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:47.353767577 +0000 UTC m=+72.468200855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhjhp" (UID: "1bcade03-751f-4323-a681-fa5bdc54e780") : configmap "kube-rbac-proxy" not found
Jul 16 11:51:46.853847 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:46.853804    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls podName:1bcade03-751f-4323-a681-fa5bdc54e780 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:47.353794704 +0000 UTC m=+72.468227958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhjhp" (UID: "1bcade03-751f-4323-a681-fa5bdc54e780") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:46.854039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.853966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1bcade03-751f-4323-a681-fa5bdc54e780-data-volume\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:46.863044 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:46.863022    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzbj8\" (UniqueName: \"kubernetes.io/projected/1bcade03-751f-4323-a681-fa5bdc54e780-kube-api-access-jzbj8\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:47.356773 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.356736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:47.356970 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.356804    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:47.356970 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:47.356855    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:51:47.356970 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:47.356915    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:47.356970 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:47.356921    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm podName:1bcade03-751f-4323-a681-fa5bdc54e780 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:48.356905164 +0000 UTC m=+73.471338436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhjhp" (UID: "1bcade03-751f-4323-a681-fa5bdc54e780") : configmap "kube-rbac-proxy" not found
Jul 16 11:51:47.356970 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:47.356971    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls podName:1bcade03-751f-4323-a681-fa5bdc54e780 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:48.356956123 +0000 UTC m=+73.471389377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhjhp" (UID: "1bcade03-751f-4323-a681-fa5bdc54e780") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:47.660607 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.660573    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-bnrml"]
Jul 16 11:51:47.663089 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.663071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.665805 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.665775    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 16 11:51:47.666147 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.666127    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:51:47.666268 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.666252    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 16 11:51:47.666335 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.666323    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 16 11:51:47.667192 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.667170    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-whv4c\""
Jul 16 11:51:47.672594 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.672567    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 16 11:51:47.677041 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.677016    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-bnrml"]
Jul 16 11:51:47.759167 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.759127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6bdc937-2e58-4ac0-810d-60c58f8a8677-config\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.759334 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.759214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6bdc937-2e58-4ac0-810d-60c58f8a8677-serving-cert\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.759396 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.759367    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6bdc937-2e58-4ac0-810d-60c58f8a8677-trusted-ca\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.759451 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.759433    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjzf9\" (UniqueName: \"kubernetes.io/projected/d6bdc937-2e58-4ac0-810d-60c58f8a8677-kube-api-access-wjzf9\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.860286 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.860241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6bdc937-2e58-4ac0-810d-60c58f8a8677-config\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.860286 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.860290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6bdc937-2e58-4ac0-810d-60c58f8a8677-serving-cert\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.860647 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.860316    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6bdc937-2e58-4ac0-810d-60c58f8a8677-trusted-ca\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.860647 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.860349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjzf9\" (UniqueName: \"kubernetes.io/projected/d6bdc937-2e58-4ac0-810d-60c58f8a8677-kube-api-access-wjzf9\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.861040 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.861019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6bdc937-2e58-4ac0-810d-60c58f8a8677-config\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.861095 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.861066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6bdc937-2e58-4ac0-810d-60c58f8a8677-trusted-ca\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.862758 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.862738    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6bdc937-2e58-4ac0-810d-60c58f8a8677-serving-cert\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.869491 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.869447    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjzf9\" (UniqueName: \"kubernetes.io/projected/d6bdc937-2e58-4ac0-810d-60c58f8a8677-kube-api-access-wjzf9\") pod \"console-operator-7866497494-bnrml\" (UID: \"d6bdc937-2e58-4ac0-810d-60c58f8a8677\") " pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:47.975858 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:47.975758    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:48.013600 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:48.013568    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:48.105509 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:48.105451    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-bnrml"]
Jul 16 11:51:48.108739 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:51:48.108710    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6bdc937_2e58_4ac0_810d_60c58f8a8677.slice/crio-7b7092ca6fbf269d1ceabc4b1ce2bc3e9a3b603a73ce1ca52a6687b8ef4d8434 WatchSource:0}: Error finding container 7b7092ca6fbf269d1ceabc4b1ce2bc3e9a3b603a73ce1ca52a6687b8ef4d8434: Status 404 returned error can't find the container with id 7b7092ca6fbf269d1ceabc4b1ce2bc3e9a3b603a73ce1ca52a6687b8ef4d8434
Jul 16 11:51:48.111631 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:48.111603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:48.335429 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:48.335350    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59grq_c8ba25d2-3518-4fc7-b87f-e5d0426a70e8/dns-node-resolver/0.log"
Jul 16 11:51:48.364722 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:48.364682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:48.364894 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:48.364757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:48.364894 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:48.364827    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:51:48.364894 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:48.364841    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:48.364894 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:48.364882    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm podName:1bcade03-751f-4323-a681-fa5bdc54e780 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:50.364867825 +0000 UTC m=+75.479301079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhjhp" (UID: "1bcade03-751f-4323-a681-fa5bdc54e780") : configmap "kube-rbac-proxy" not found
Jul 16 11:51:48.364894 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:48.364894    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls podName:1bcade03-751f-4323-a681-fa5bdc54e780 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:50.364888619 +0000 UTC m=+75.479321874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhjhp" (UID: "1bcade03-751f-4323-a681-fa5bdc54e780") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:48.711938 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:48.711901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:48.717221 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:48.717194    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bnrml" event={"ID":"d6bdc937-2e58-4ac0-810d-60c58f8a8677","Type":"ContainerStarted","Data":"7b7092ca6fbf269d1ceabc4b1ce2bc3e9a3b603a73ce1ca52a6687b8ef4d8434"}
Jul 16 11:51:48.776752 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:48.776716    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:49.136215 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:49.136186    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qmqbw_92fa8300-ff78-4723-a701-d94ed3a1600d/node-ca/0.log"
Jul 16 11:51:49.936818 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:49.936785    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dks4s_7ee51f50-1a16-43a0-8c51-62f57e9cb40f/serve-healthcheck-canary/0.log"
Jul 16 11:51:50.379574 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:50.379545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:50.379695 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:50.379608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:50.379695 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:50.379680    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:51:50.379764 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:50.379721    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:50.379764 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:50.379745    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm podName:1bcade03-751f-4323-a681-fa5bdc54e780 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:54.379728618 +0000 UTC m=+79.494161872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhjhp" (UID: "1bcade03-751f-4323-a681-fa5bdc54e780") : configmap "kube-rbac-proxy" not found
Jul 16 11:51:50.379840 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:50.379769    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls podName:1bcade03-751f-4323-a681-fa5bdc54e780 nodeName:}" failed. No retries permitted until 2026-07-16 11:51:54.379762936 +0000 UTC m=+79.494196189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhjhp" (UID: "1bcade03-751f-4323-a681-fa5bdc54e780") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:50.723761 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:50.723736    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/0.log"
Jul 16 11:51:50.723916 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:50.723774    2580 generic.go:356] "Generic (PLEG): container finished" podID="d6bdc937-2e58-4ac0-810d-60c58f8a8677" containerID="7892cd1f08d8a5a303d989ccc43f5ba910af904e77480b93062021e3d67c0b4a" exitCode=255
Jul 16 11:51:50.723916 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:50.723839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bnrml" event={"ID":"d6bdc937-2e58-4ac0-810d-60c58f8a8677","Type":"ContainerDied","Data":"7892cd1f08d8a5a303d989ccc43f5ba910af904e77480b93062021e3d67c0b4a"}
Jul 16 11:51:50.724045 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:50.724028    2580 scope.go:117] "RemoveContainer" containerID="7892cd1f08d8a5a303d989ccc43f5ba910af904e77480b93062021e3d67c0b4a"
Jul 16 11:51:51.728888 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:51.728857    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/1.log"
Jul 16 11:51:51.729316 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:51.729280    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/0.log"
Jul 16 11:51:51.729363 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:51.729312    2580 generic.go:356] "Generic (PLEG): container finished" podID="d6bdc937-2e58-4ac0-810d-60c58f8a8677" containerID="72ed54cc98466d8331fa838df0e50ec082c5f4680622442e0e6722838f79c40c" exitCode=255
Jul 16 11:51:51.729363 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:51.729347    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bnrml" event={"ID":"d6bdc937-2e58-4ac0-810d-60c58f8a8677","Type":"ContainerDied","Data":"72ed54cc98466d8331fa838df0e50ec082c5f4680622442e0e6722838f79c40c"}
Jul 16 11:51:51.729418 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:51.729389    2580 scope.go:117] "RemoveContainer" containerID="7892cd1f08d8a5a303d989ccc43f5ba910af904e77480b93062021e3d67c0b4a"
Jul 16 11:51:51.729669 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:51.729630    2580 scope.go:117] "RemoveContainer" containerID="72ed54cc98466d8331fa838df0e50ec082c5f4680622442e0e6722838f79c40c"
Jul 16 11:51:51.729831 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:51.729808    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-bnrml_openshift-console-operator(d6bdc937-2e58-4ac0-810d-60c58f8a8677)\"" pod="openshift-console-operator/console-operator-7866497494-bnrml" podUID="d6bdc937-2e58-4ac0-810d-60c58f8a8677"
Jul 16 11:51:52.733115 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:52.733088    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/1.log"
Jul 16 11:51:52.733513 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:52.733397    2580 scope.go:117] "RemoveContainer" containerID="72ed54cc98466d8331fa838df0e50ec082c5f4680622442e0e6722838f79c40c"
Jul 16 11:51:52.733581 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:52.733562    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-bnrml_openshift-console-operator(d6bdc937-2e58-4ac0-810d-60c58f8a8677)\"" pod="openshift-console-operator/console-operator-7866497494-bnrml" podUID="d6bdc937-2e58-4ac0-810d-60c58f8a8677"
Jul 16 11:51:54.413775 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:54.413727    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:54.414259 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:54.413795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:51:54.414259 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:54.413874    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 11:51:54.414259 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:54.413896    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:54.414259 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:54.413968    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls podName:1bcade03-751f-4323-a681-fa5bdc54e780 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:02.41395355 +0000 UTC m=+87.528386804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhjhp" (UID: "1bcade03-751f-4323-a681-fa5bdc54e780") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:51:54.414259 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:54.413981    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm podName:1bcade03-751f-4323-a681-fa5bdc54e780 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:02.413974506 +0000 UTC m=+87.528407761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhjhp" (UID: "1bcade03-751f-4323-a681-fa5bdc54e780") : configmap "kube-rbac-proxy" not found
Jul 16 11:51:54.566921 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:54.566889    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:54.623627 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:54.623596    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:56.399164 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:56.399109    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:56.533044 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:56.533006    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:57.975996 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:57.975945    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:57.976512 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:57.976026    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:51:57.976512 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:57.976443    2580 scope.go:117] "RemoveContainer" containerID="72ed54cc98466d8331fa838df0e50ec082c5f4680622442e0e6722838f79c40c"
Jul 16 11:51:57.976684 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:51:57.976660    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-bnrml_openshift-console-operator(d6bdc937-2e58-4ac0-810d-60c58f8a8677)\"" pod="openshift-console-operator/console-operator-7866497494-bnrml" podUID="d6bdc937-2e58-4ac0-810d-60c58f8a8677"
Jul 16 11:51:58.328662 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:58.328570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:58.465369 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:58.465334    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:59.373958 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.373926    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm"]
Jul 16 11:51:59.377903 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.377885    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm"
Jul 16 11:51:59.381954 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.381934    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 16 11:51:59.382911 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.382886    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sj285\""
Jul 16 11:51:59.383092 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.383070    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 16 11:51:59.409385 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.409351    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:59.427571 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.427541    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm"]
Jul 16 11:51:59.449143 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.449109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz8ll\" (UniqueName: \"kubernetes.io/projected/d44e5d29-9c1b-4651-9432-5264cb1ba611-kube-api-access-tz8ll\") pod \"migrator-7f59b54f6c-25qlm\" (UID: \"d44e5d29-9c1b-4651-9432-5264cb1ba611\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm"
Jul 16 11:51:59.508856 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.508814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:51:59.549931 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.549897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz8ll\" (UniqueName: \"kubernetes.io/projected/d44e5d29-9c1b-4651-9432-5264cb1ba611-kube-api-access-tz8ll\") pod \"migrator-7f59b54f6c-25qlm\" (UID: \"d44e5d29-9c1b-4651-9432-5264cb1ba611\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm"
Jul 16 11:51:59.560039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.560013    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz8ll\" (UniqueName: \"kubernetes.io/projected/d44e5d29-9c1b-4651-9432-5264cb1ba611-kube-api-access-tz8ll\") pod \"migrator-7f59b54f6c-25qlm\" (UID: \"d44e5d29-9c1b-4651-9432-5264cb1ba611\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm"
Jul 16 11:51:59.685896 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.685862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm"
Jul 16 11:51:59.811815 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.811782    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm"]
Jul 16 11:51:59.815561 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:51:59.815525    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44e5d29_9c1b_4651_9432_5264cb1ba611.slice/crio-14bb0eb82fa02821173f8bbbdb5664bc9be533af70458c90ea2e9fc23af526ff WatchSource:0}: Error finding container 14bb0eb82fa02821173f8bbbdb5664bc9be533af70458c90ea2e9fc23af526ff: Status 404 returned error can't find the container with id 14bb0eb82fa02821173f8bbbdb5664bc9be533af70458c90ea2e9fc23af526ff
Jul 16 11:51:59.849508 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:51:59.849434    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:00.676487 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:00.676420    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:00.755556 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:00.755523    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm" event={"ID":"d44e5d29-9c1b-4651-9432-5264cb1ba611","Type":"ContainerStarted","Data":"14bb0eb82fa02821173f8bbbdb5664bc9be533af70458c90ea2e9fc23af526ff"}
Jul 16 11:52:00.782307 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:00.782249    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:00.871633 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:00.871593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:01.209317 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:01.209282    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:01.311579 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:01.311544    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:01.504681 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:01.504574    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:01.610484 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:01.610434    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:02.472202 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:02.472163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:52:02.472618 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:02.472243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:52:02.472618 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:02.472397    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 11:52:02.472618 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:02.472499    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls podName:1bcade03-751f-4323-a681-fa5bdc54e780 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:18.472475853 +0000 UTC m=+103.586909133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhjhp" (UID: "1bcade03-751f-4323-a681-fa5bdc54e780") : secret "insights-runtime-extractor-tls" not found
Jul 16 11:52:02.472824 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:02.472807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1bcade03-751f-4323-a681-fa5bdc54e780-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:52:03.128318 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:03.128287    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:03.207205 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:03.207175    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:03.769093 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:03.769009    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm" event={"ID":"d44e5d29-9c1b-4651-9432-5264cb1ba611","Type":"ContainerStarted","Data":"ffd3e294a7788e35af582292a33e83b29d45b34c81581db572609582de0b5f8e"}
Jul 16 11:52:03.769093 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:03.769081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm" event={"ID":"d44e5d29-9c1b-4651-9432-5264cb1ba611","Type":"ContainerStarted","Data":"4b943f457fd1aa5be6ac87fa9cc8fd831d799bfd15663b905bd34455e1858714"}
Jul 16 11:52:03.792345 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:03.792290    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-25qlm" podStartSLOduration=1.206117297 podStartE2EDuration="4.792273904s" totalImagesPullingTime="3.586156607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:03.792113263 +0000 UTC m=+88.906546538" watchObservedRunningTime="2026-07-16 11:52:03.792273904 +0000 UTC m=+88.906707180"
Jul 16 11:52:04.242608 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:04.242562    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:04.836664 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:04.836630    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:07.320286 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:07.320252    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:07.407785 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:07.407748    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:07.923701 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:07.923653    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:08.126069 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:08.126035    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:08.512861 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:08.512831    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:08.650849 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:08.650814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:09.050060 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:09.050021    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:09.164147 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:09.164113    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:09.268227 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:09.268199    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:09.829137 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:09.829104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:09.927489 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:09.927440    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:10.355472 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:10.355436    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:10.393640 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:10.393614    2580 scope.go:117] "RemoveContainer" containerID="72ed54cc98466d8331fa838df0e50ec082c5f4680622442e0e6722838f79c40c"
Jul 16 11:52:10.717763 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:10.717729    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:10.791427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:10.791402    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 11:52:10.791832 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:10.791815    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/1.log"
Jul 16 11:52:10.791939 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:10.791852    2580 generic.go:356] "Generic (PLEG): container finished" podID="d6bdc937-2e58-4ac0-810d-60c58f8a8677" containerID="081c5f05bab09111aaa1788df68a3c0a2ec2b992e1aea1e0e946ad02748ee878" exitCode=255
Jul 16 11:52:10.791939 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:10.791906    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bnrml" event={"ID":"d6bdc937-2e58-4ac0-810d-60c58f8a8677","Type":"ContainerDied","Data":"081c5f05bab09111aaa1788df68a3c0a2ec2b992e1aea1e0e946ad02748ee878"}
Jul 16 11:52:10.792048 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:10.791965    2580 scope.go:117] "RemoveContainer" containerID="72ed54cc98466d8331fa838df0e50ec082c5f4680622442e0e6722838f79c40c"
Jul 16 11:52:10.792241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:10.792226    2580 scope.go:117] "RemoveContainer" containerID="081c5f05bab09111aaa1788df68a3c0a2ec2b992e1aea1e0e946ad02748ee878"
Jul 16 11:52:10.792491 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:10.792448    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-bnrml_openshift-console-operator(d6bdc937-2e58-4ac0-810d-60c58f8a8677)\"" pod="openshift-console-operator/console-operator-7866497494-bnrml" podUID="d6bdc937-2e58-4ac0-810d-60c58f8a8677"
Jul 16 11:52:11.057077 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:11.056985    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:11.158813 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:11.158775    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:11.514760 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:11.514726    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:11.723540 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:11.723514    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:11.796870 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:11.796801    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 11:52:12.129295 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:12.129206    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:14.667543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:14.667506    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:52:14.669784 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:14.669762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") pod \"image-registry-547b748b65-r7tmb\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") " pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:52:14.686767 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:14.686744    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pbnkd\""
Jul 16 11:52:14.694467 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:14.694430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:52:14.767825 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:14.767793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:52:14.770005 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:14.769984    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c167e8d9-64a9-4a36-8363-40890e887794-metrics-tls\") pod \"dns-default-n87tk\" (UID: \"c167e8d9-64a9-4a36-8363-40890e887794\") " pod="openshift-dns/dns-default-n87tk"
Jul 16 11:52:14.833838 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:14.833721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-547b748b65-r7tmb"]
Jul 16 11:52:14.836241 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:14.836215    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc479f8de_037a_47d2_a6ec_985422170058.slice/crio-243b32f5df11eca182f3a210bbab29261e6bce7400dc6a4bd8ec354c29dbd481 WatchSource:0}: Error finding container 243b32f5df11eca182f3a210bbab29261e6bce7400dc6a4bd8ec354c29dbd481: Status 404 returned error can't find the container with id 243b32f5df11eca182f3a210bbab29261e6bce7400dc6a4bd8ec354c29dbd481
Jul 16 11:52:15.028536 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:15.028452    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b759k\""
Jul 16 11:52:15.034940 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:15.034926    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n87tk"
Jul 16 11:52:15.167378 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:15.167335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n87tk"]
Jul 16 11:52:15.172137 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:15.172110    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc167e8d9_64a9_4a36_8363_40890e887794.slice/crio-22dd1075189d0f4ed85c01dfd4161177ce95eace8f6a7bea6661fdd90b0ef1dd WatchSource:0}: Error finding container 22dd1075189d0f4ed85c01dfd4161177ce95eace8f6a7bea6661fdd90b0ef1dd: Status 404 returned error can't find the container with id 22dd1075189d0f4ed85c01dfd4161177ce95eace8f6a7bea6661fdd90b0ef1dd
Jul 16 11:52:15.544175 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:15.544139    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:15.653374 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:15.653339    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:15.809923 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:15.809882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n87tk" event={"ID":"c167e8d9-64a9-4a36-8363-40890e887794","Type":"ContainerStarted","Data":"22dd1075189d0f4ed85c01dfd4161177ce95eace8f6a7bea6661fdd90b0ef1dd"}
Jul 16 11:52:15.811601 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:15.811572    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-547b748b65-r7tmb" event={"ID":"c479f8de-037a-47d2-a6ec-985422170058","Type":"ContainerStarted","Data":"517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7"}
Jul 16 11:52:15.811727 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:15.811615    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-547b748b65-r7tmb" event={"ID":"c479f8de-037a-47d2-a6ec-985422170058","Type":"ContainerStarted","Data":"243b32f5df11eca182f3a210bbab29261e6bce7400dc6a4bd8ec354c29dbd481"}
Jul 16 11:52:15.811727 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:15.811720    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:52:15.845413 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:15.845363    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-547b748b65-r7tmb" podStartSLOduration=100.845348441 podStartE2EDuration="1m40.845348441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:15.844037674 +0000 UTC m=+100.958470962" watchObservedRunningTime="2026-07-16 11:52:15.845348441 +0000 UTC m=+100.959781717"
Jul 16 11:52:17.601068 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:17.601024    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:17.716953 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:17.716921    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8kbvl"
Jul 16 11:52:17.757691 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:17.757655    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:17.818937 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:17.818905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n87tk" event={"ID":"c167e8d9-64a9-4a36-8363-40890e887794","Type":"ContainerStarted","Data":"b46072dd33cb1eb45e69e7e76b0165854aa5b08e09cd9e62c1b9a98490e93614"}
Jul 16 11:52:17.819047 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:17.818956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n87tk" event={"ID":"c167e8d9-64a9-4a36-8363-40890e887794","Type":"ContainerStarted","Data":"144027db6eb635f329cd3d8b2922f6a69923881c48f3d2d1a00f2940f085c430"}
Jul 16 11:52:17.819047 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:17.819027    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n87tk"
Jul 16 11:52:17.862301 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:17.862210    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n87tk" podStartSLOduration=65.945510378 podStartE2EDuration="1m7.862196237s" totalImagesPullingTime="1.916685859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:17.861895885 +0000 UTC m=+102.976329159" watchObservedRunningTime="2026-07-16 11:52:17.862196237 +0000 UTC m=+102.976629512"
Jul 16 11:52:17.920322 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:17.920301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:17.976193 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:17.976169    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:52:17.976417 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:17.976398    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:52:17.976515 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:17.976452    2580 scope.go:117] "RemoveContainer" containerID="081c5f05bab09111aaa1788df68a3c0a2ec2b992e1aea1e0e946ad02748ee878"
Jul 16 11:52:17.976614 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:17.976596    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-bnrml_openshift-console-operator(d6bdc937-2e58-4ac0-810d-60c58f8a8677)\"" pod="openshift-console-operator/console-operator-7866497494-bnrml" podUID="d6bdc937-2e58-4ac0-810d-60c58f8a8677"
Jul 16 11:52:18.496863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:18.496829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:52:18.499168 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:18.499137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1bcade03-751f-4323-a681-fa5bdc54e780-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhjhp\" (UID: \"1bcade03-751f-4323-a681-fa5bdc54e780\") " pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:52:18.751131 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:18.751056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nhjhp"
Jul 16 11:52:18.823485 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:18.823143    2580 scope.go:117] "RemoveContainer" containerID="081c5f05bab09111aaa1788df68a3c0a2ec2b992e1aea1e0e946ad02748ee878"
Jul 16 11:52:18.823485 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:18.823286    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-bnrml_openshift-console-operator(d6bdc937-2e58-4ac0-810d-60c58f8a8677)\"" pod="openshift-console-operator/console-operator-7866497494-bnrml" podUID="d6bdc937-2e58-4ac0-810d-60c58f8a8677"
Jul 16 11:52:18.896185 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:18.896159    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nhjhp"]
Jul 16 11:52:18.898594 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:18.898566    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bcade03_751f_4323_a681_fa5bdc54e780.slice/crio-dfbb2330eb26a2d504685f4772e75c8dab9fe30f3096fbc9dc097120988c4803 WatchSource:0}: Error finding container dfbb2330eb26a2d504685f4772e75c8dab9fe30f3096fbc9dc097120988c4803: Status 404 returned error can't find the container with id dfbb2330eb26a2d504685f4772e75c8dab9fe30f3096fbc9dc097120988c4803
Jul 16 11:52:19.827055 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:19.827018    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhjhp" event={"ID":"1bcade03-751f-4323-a681-fa5bdc54e780","Type":"ContainerStarted","Data":"dfbb2330eb26a2d504685f4772e75c8dab9fe30f3096fbc9dc097120988c4803"}
Jul 16 11:52:27.825120 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:27.825087    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n87tk"
Jul 16 11:52:28.409995 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:28.409960    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:28.478280 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:28.478208    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:28.984207 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:28.984174    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr"]
Jul 16 11:52:28.990838 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:28.990814    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr"
Jul 16 11:52:29.001221 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.001200    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 11:52:29.001410 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.001392    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 11:52:29.001564 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.001543    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fglvc\""
Jul 16 11:52:29.001646 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.001551    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 11:52:29.001646 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.001610    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 16 11:52:29.011061 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.011039    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr"]
Jul 16 11:52:29.088236 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.088203    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-w5jsz"]
Jul 16 11:52:29.091325 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.091302    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-w5jsz"
Jul 16 11:52:29.094555 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.094523    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 16 11:52:29.094870 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.094851    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tmqvt\""
Jul 16 11:52:29.094927 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.094851    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 16 11:52:29.106958 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.106930    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-w5jsz"]
Jul 16 11:52:29.111091 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.111067    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:29.175975 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.175951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4cp7\" (UniqueName: \"kubernetes.io/projected/5ce062e2-aefa-40a9-b516-55f6b7d0ecbb-kube-api-access-j4cp7\") pod \"managed-serviceaccount-addon-agent-f69977cc8-vlbdr\" (UID: \"5ce062e2-aefa-40a9-b516-55f6b7d0ecbb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr"
Jul 16 11:52:29.176107 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.176034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ce062e2-aefa-40a9-b516-55f6b7d0ecbb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f69977cc8-vlbdr\" (UID: \"5ce062e2-aefa-40a9-b516-55f6b7d0ecbb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr"
Jul 16 11:52:29.276378 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.276301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ce062e2-aefa-40a9-b516-55f6b7d0ecbb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f69977cc8-vlbdr\" (UID: \"5ce062e2-aefa-40a9-b516-55f6b7d0ecbb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr"
Jul 16 11:52:29.276378 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.276338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bbd90a4-7d2b-4007-b13e-2f871309e7e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w5jsz\" (UID: \"7bbd90a4-7d2b-4007-b13e-2f871309e7e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5jsz"
Jul 16 11:52:29.276586 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.276389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4cp7\" (UniqueName: \"kubernetes.io/projected/5ce062e2-aefa-40a9-b516-55f6b7d0ecbb-kube-api-access-j4cp7\") pod \"managed-serviceaccount-addon-agent-f69977cc8-vlbdr\" (UID: \"5ce062e2-aefa-40a9-b516-55f6b7d0ecbb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr"
Jul 16 11:52:29.276586 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.276502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7bbd90a4-7d2b-4007-b13e-2f871309e7e9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-w5jsz\" (UID: \"7bbd90a4-7d2b-4007-b13e-2f871309e7e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5jsz"
Jul 16 11:52:29.279150 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.279125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ce062e2-aefa-40a9-b516-55f6b7d0ecbb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f69977cc8-vlbdr\" (UID: \"5ce062e2-aefa-40a9-b516-55f6b7d0ecbb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr"
Jul 16 11:52:29.298808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.298784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4cp7\" (UniqueName: \"kubernetes.io/projected/5ce062e2-aefa-40a9-b516-55f6b7d0ecbb-kube-api-access-j4cp7\") pod \"managed-serviceaccount-addon-agent-f69977cc8-vlbdr\" (UID: \"5ce062e2-aefa-40a9-b516-55f6b7d0ecbb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr"
Jul 16 11:52:29.303336 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.303301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:29.313916 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.313890    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr"
Jul 16 11:52:29.377604 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.377560    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bbd90a4-7d2b-4007-b13e-2f871309e7e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w5jsz\" (UID: \"7bbd90a4-7d2b-4007-b13e-2f871309e7e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5jsz"
Jul 16 11:52:29.377816 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.377663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7bbd90a4-7d2b-4007-b13e-2f871309e7e9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-w5jsz\" (UID: \"7bbd90a4-7d2b-4007-b13e-2f871309e7e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5jsz"
Jul 16 11:52:29.378402 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.378376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7bbd90a4-7d2b-4007-b13e-2f871309e7e9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-w5jsz\" (UID: \"7bbd90a4-7d2b-4007-b13e-2f871309e7e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5jsz"
Jul 16 11:52:29.381264 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.381237    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bbd90a4-7d2b-4007-b13e-2f871309e7e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-w5jsz\" (UID: \"7bbd90a4-7d2b-4007-b13e-2f871309e7e9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-w5jsz"
Jul 16 11:52:29.401165 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.401015    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-w5jsz"
Jul 16 11:52:29.401314 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.401282    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:29.497120 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.496920    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:29.529943 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.529920    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr"]
Jul 16 11:52:29.533348 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:29.533320    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ce062e2_aefa_40a9_b516_55f6b7d0ecbb.slice/crio-78d8bd566141c656d77804779b938808d535a99c82d403ebdced0d95a54346ad WatchSource:0}: Error finding container 78d8bd566141c656d77804779b938808d535a99c82d403ebdced0d95a54346ad: Status 404 returned error can't find the container with id 78d8bd566141c656d77804779b938808d535a99c82d403ebdced0d95a54346ad
Jul 16 11:52:29.552292 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.552251    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-w5jsz"]
Jul 16 11:52:29.555026 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:29.555005    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bbd90a4_7d2b_4007_b13e_2f871309e7e9.slice/crio-a80e2daf78992c0304cb7a3854408dc9f4d686e1d8d61eb62ba2a5e2509c309a WatchSource:0}: Error finding container a80e2daf78992c0304cb7a3854408dc9f4d686e1d8d61eb62ba2a5e2509c309a: Status 404 returned error can't find the container with id a80e2daf78992c0304cb7a3854408dc9f4d686e1d8d61eb62ba2a5e2509c309a
Jul 16 11:52:29.862280 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.862197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhjhp" event={"ID":"1bcade03-751f-4323-a681-fa5bdc54e780","Type":"ContainerStarted","Data":"191ab80e408a3c1621425442361470b69664e22c4f5142db308d08dd3d29fd4d"}
Jul 16 11:52:29.863451 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.863413    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr" event={"ID":"5ce062e2-aefa-40a9-b516-55f6b7d0ecbb","Type":"ContainerStarted","Data":"78d8bd566141c656d77804779b938808d535a99c82d403ebdced0d95a54346ad"}
Jul 16 11:52:29.864444 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:29.864417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-w5jsz" event={"ID":"7bbd90a4-7d2b-4007-b13e-2f871309e7e9","Type":"ContainerStarted","Data":"a80e2daf78992c0304cb7a3854408dc9f4d686e1d8d61eb62ba2a5e2509c309a"}
Jul 16 11:52:30.394446 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:30.394368    2580 scope.go:117] "RemoveContainer" containerID="081c5f05bab09111aaa1788df68a3c0a2ec2b992e1aea1e0e946ad02748ee878"
Jul 16 11:52:30.394982 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:30.394572    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-bnrml_openshift-console-operator(d6bdc937-2e58-4ac0-810d-60c58f8a8677)\"" pod="openshift-console-operator/console-operator-7866497494-bnrml" podUID="d6bdc937-2e58-4ac0-810d-60c58f8a8677"
Jul 16 11:52:33.693134 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:33.693096    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:33.800029 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:33.799992    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:34.182074 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:34.182033    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:34.699190 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:34.699163    2580 patch_prober.go:28] interesting pod/image-registry-547b748b65-r7tmb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 16 11:52:34.699535 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:34.699209    2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-547b748b65-r7tmb" podUID="c479f8de-037a-47d2-a6ec-985422170058" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 11:52:34.887983 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:34.887946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhjhp" event={"ID":"1bcade03-751f-4323-a681-fa5bdc54e780","Type":"ContainerStarted","Data":"710166c8f915555965018026aca27387dee02022ad6bf24ef84d5ac113374087"}
Jul 16 11:52:34.889430 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:34.889399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr" event={"ID":"5ce062e2-aefa-40a9-b516-55f6b7d0ecbb","Type":"ContainerStarted","Data":"295ba7a020d64dfa50646b8a92bf95b4930b5037d449814e503b23eb0880197e"}
Jul 16 11:52:34.891023 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:34.890987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-w5jsz" event={"ID":"7bbd90a4-7d2b-4007-b13e-2f871309e7e9","Type":"ContainerStarted","Data":"8912667d749eed723dea052cadfbde8f6c3c3d84e62808e25ad0f90a1864b8cb"}
Jul 16 11:52:34.908334 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:34.908275    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f69977cc8-vlbdr" podStartSLOduration=2.074520651 podStartE2EDuration="6.908254456s" totalImagesPullingTime="4.833733805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:34.907970246 +0000 UTC m=+120.022403521" watchObservedRunningTime="2026-07-16 11:52:34.908254456 +0000 UTC m=+120.022687713"
Jul 16 11:52:34.928603 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:34.928548    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-w5jsz" podStartSLOduration=1.069047564 podStartE2EDuration="5.928531615s" totalImagesPullingTime="4.859484051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:34.927705424 +0000 UTC m=+120.042138693" watchObservedRunningTime="2026-07-16 11:52:34.928531615 +0000 UTC m=+120.042964890"
Jul 16 11:52:35.051815 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:35.051661    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:35.152694 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:35.152652    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:36.820700 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:36.820669    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:52:37.075100 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:37.075004    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:37.140687 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:37.140656    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:37.902756 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:37.902724    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhjhp" event={"ID":"1bcade03-751f-4323-a681-fa5bdc54e780","Type":"ContainerStarted","Data":"72ad23b4b35eaa581fb3a25e91d1479bbf5ebab4e851e5ac529992d038efbec1"}
Jul 16 11:52:37.925042 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:37.925001    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nhjhp" podStartSLOduration=33.254792987 podStartE2EDuration="51.924987659s" totalImagesPullingTime="18.670194672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 11:51:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:37.92398132 +0000 UTC m=+123.038414594" watchObservedRunningTime="2026-07-16 11:52:37.924987659 +0000 UTC m=+123.039420934"
Jul 16 11:52:38.069350 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:38.069282    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:38.173346 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:38.173325    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:39.587809 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:39.587772    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:41.380851 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.380816    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"]
Jul 16 11:52:41.384168 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.384152    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"]
Jul 16 11:52:41.384284 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.384266    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.387044 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.387026    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.392403 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.392386    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 16 11:52:41.393690 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.393660    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 16 11:52:41.393794 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.393699    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-59m4k\""
Jul 16 11:52:41.394193 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.394170    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 11:52:41.394300 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.394190    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 16 11:52:41.394300 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.394194    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 16 11:52:41.394300 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.394188    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 11:52:41.394533 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.394518    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 16 11:52:41.394592 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.394576    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dsj8f\""
Jul 16 11:52:41.394699 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.394667    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 11:52:41.415324 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.415306    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hdrf2"]
Jul 16 11:52:41.418368 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.418355    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.423154 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.423132    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vz9xv\""
Jul 16 11:52:41.423250 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.423172    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 11:52:41.423250 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.423225    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 11:52:41.423250 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.423226    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 11:52:41.432385 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.432366    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"]
Jul 16 11:52:41.433299 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.433278    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"]
Jul 16 11:52:41.462883 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.462862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.462980 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.462891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.462980 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.462911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-wtmp\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.462980 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.462929    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-sys\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.463104 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-textfile\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.463104 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463037    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-tls\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.463104 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.463104 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463097    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.463235 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d444a61f-c95d-4831-ad0f-bfe9aa85715c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.463235 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463178    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/958df694-af55-4f14-aafd-bd38fb2f7f71-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.463235 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-metrics-client-ca\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.463235 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463209    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm9xb\" (UniqueName: \"kubernetes.io/projected/958df694-af55-4f14-aafd-bd38fb2f7f71-kube-api-access-bm9xb\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.463384 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.463384 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p228\" (UniqueName: \"kubernetes.io/projected/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-api-access-7p228\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.463384 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85bk8\" (UniqueName: \"kubernetes.io/projected/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-kube-api-access-85bk8\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.463384 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-root\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.463384 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/958df694-af55-4f14-aafd-bd38fb2f7f71-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.463384 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/958df694-af55-4f14-aafd-bd38fb2f7f71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.463681 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.463386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d444a61f-c95d-4831-ad0f-bfe9aa85715c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.564126 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d444a61f-c95d-4831-ad0f-bfe9aa85715c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.564289 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.564289 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.564289 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-wtmp\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.564289 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:41.564269    2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 16 11:52:41.564289 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-sys\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.564586 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564302    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-wtmp\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.564586 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-textfile\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.564586 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-sys\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.564586 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:41.564346    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-tls podName:d444a61f-c95d-4831-ad0f-bfe9aa85715c nodeName:}" failed. No retries permitted until 2026-07-16 11:52:42.064325547 +0000 UTC m=+127.178758806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-xb4w9" (UID: "d444a61f-c95d-4831-ad0f-bfe9aa85715c") : secret "kube-state-metrics-tls" not found
Jul 16 11:52:41.564586 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-tls\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.564586 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564434    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.564586 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.564586 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d444a61f-c95d-4831-ad0f-bfe9aa85715c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.564586 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d444a61f-c95d-4831-ad0f-bfe9aa85715c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.564586 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/958df694-af55-4f14-aafd-bd38fb2f7f71-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564602    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-metrics-client-ca\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm9xb\" (UniqueName: \"kubernetes.io/projected/958df694-af55-4f14-aafd-bd38fb2f7f71-kube-api-access-bm9xb\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-textfile\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p228\" (UniqueName: \"kubernetes.io/projected/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-api-access-7p228\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85bk8\" (UniqueName: \"kubernetes.io/projected/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-kube-api-access-85bk8\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-root\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564788    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/958df694-af55-4f14-aafd-bd38fb2f7f71-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.564821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/958df694-af55-4f14-aafd-bd38fb2f7f71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:41.564945    2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:41.564994    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/958df694-af55-4f14-aafd-bd38fb2f7f71-openshift-state-metrics-tls podName:958df694-af55-4f14-aafd-bd38fb2f7f71 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:42.064977676 +0000 UTC m=+127.179410947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/958df694-af55-4f14-aafd-bd38fb2f7f71-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-qfbqg" (UID: "958df694-af55-4f14-aafd-bd38fb2f7f71") : secret "openshift-state-metrics-tls" not found
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.565145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-metrics-client-ca\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.565201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.565241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.565230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/958df694-af55-4f14-aafd-bd38fb2f7f71-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.566011 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.565282    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-accelerators-collector-config\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.566011 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.565292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-root\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.566011 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.565698    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d444a61f-c95d-4831-ad0f-bfe9aa85715c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.567098 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.567067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.567098 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.567081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-tls\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.567322 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.567289    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.567542 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.567526    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/958df694-af55-4f14-aafd-bd38fb2f7f71-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.581895 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.581867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm9xb\" (UniqueName: \"kubernetes.io/projected/958df694-af55-4f14-aafd-bd38fb2f7f71-kube-api-access-bm9xb\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:41.586315 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.586294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p228\" (UniqueName: \"kubernetes.io/projected/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-api-access-7p228\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:41.588435 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.588413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85bk8\" (UniqueName: \"kubernetes.io/projected/e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a-kube-api-access-85bk8\") pod \"node-exporter-hdrf2\" (UID: \"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a\") " pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.726706 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.726646    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hdrf2"
Jul 16 11:52:41.737848 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:41.737820    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode429eee7_1e47_4dd6_bb9d_83d4fefd2c7a.slice/crio-b13b53a386f159e118e35aae94bd6ca1a8e8fb527bda5dbed13898036f0e9592 WatchSource:0}: Error finding container b13b53a386f159e118e35aae94bd6ca1a8e8fb527bda5dbed13898036f0e9592: Status 404 returned error can't find the container with id b13b53a386f159e118e35aae94bd6ca1a8e8fb527bda5dbed13898036f0e9592
Jul 16 11:52:41.915823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:41.915791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdrf2" event={"ID":"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a","Type":"ContainerStarted","Data":"b13b53a386f159e118e35aae94bd6ca1a8e8fb527bda5dbed13898036f0e9592"}
Jul 16 11:52:42.069389 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.069298    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/958df694-af55-4f14-aafd-bd38fb2f7f71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:42.069389 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.069358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:42.071872 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.071842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d444a61f-c95d-4831-ad0f-bfe9aa85715c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-xb4w9\" (UID: \"d444a61f-c95d-4831-ad0f-bfe9aa85715c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:42.072006 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.071915    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/958df694-af55-4f14-aafd-bd38fb2f7f71-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qfbqg\" (UID: \"958df694-af55-4f14-aafd-bd38fb2f7f71\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:42.294504 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.294474    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"
Jul 16 11:52:42.299636 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.299614    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"
Jul 16 11:52:42.394269 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.394244    2580 scope.go:117] "RemoveContainer" containerID="081c5f05bab09111aaa1788df68a3c0a2ec2b992e1aea1e0e946ad02748ee878"
Jul 16 11:52:42.468527 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.468441    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg"]
Jul 16 11:52:42.471009 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:42.470983    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958df694_af55_4f14_aafd_bd38fb2f7f71.slice/crio-efa98fabfdb4d20e970c585cc88abe0b21cb974810a4997372d35131464fc07a WatchSource:0}: Error finding container efa98fabfdb4d20e970c585cc88abe0b21cb974810a4997372d35131464fc07a: Status 404 returned error can't find the container with id efa98fabfdb4d20e970c585cc88abe0b21cb974810a4997372d35131464fc07a
Jul 16 11:52:42.482160 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.482130    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-xb4w9"]
Jul 16 11:52:42.486041 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:42.486015    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd444a61f_c95d_4831_ad0f_bfe9aa85715c.slice/crio-0ea8f9bbe786e90599fec5a9a6ca61f114eec67820f74fb063dfd468103ae9b8 WatchSource:0}: Error finding container 0ea8f9bbe786e90599fec5a9a6ca61f114eec67820f74fb063dfd468103ae9b8: Status 404 returned error can't find the container with id 0ea8f9bbe786e90599fec5a9a6ca61f114eec67820f74fb063dfd468103ae9b8
Jul 16 11:52:42.618877 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.618840    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 11:52:42.623995 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.623977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.628249 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.628229    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 11:52:42.628343 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.628229    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 11:52:42.628343 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.628260    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cg8c9\""
Jul 16 11:52:42.629340 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.629102    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 11:52:42.629340 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.629202    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 11:52:42.629556 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.629427    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 11:52:42.629556 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.629501    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 11:52:42.629666 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.629631    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 11:52:42.629808 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.629778    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 11:52:42.633958 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.633919    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 11:52:42.651646 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.651618    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 11:52:42.674738 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.674738 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.674738 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.674738 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.674738 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.674738 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.675116 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674781    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.675116 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7wqm\" (UniqueName: \"kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-kube-api-access-z7wqm\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.675116 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674848    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.675116 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-out\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.675116 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.675116 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-web-config\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.675116 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.674982    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776245 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776201    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776421 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776421 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776421 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776421 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776421 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776421 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776747 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7wqm\" (UniqueName: \"kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-kube-api-access-z7wqm\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776747 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776747 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-out\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776747 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776747 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-web-config\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.776747 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.776615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.777741 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:42.777230    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-trusted-ca-bundle podName:f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:43.277202783 +0000 UTC m=+128.391636050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0") : configmap references non-existent config key: ca-bundle.crt
Jul 16 11:52:42.777741 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.777544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.777741 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.777645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.779519 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.779495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-out\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.780671 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.780593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.781205 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.781183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.781717 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.781693    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.781805 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.781772    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-volume\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.781930 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.781904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-web-config\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.782447 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.782238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.782447 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.782410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.784236 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.784203    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.795625 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.795602    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7wqm\" (UniqueName: \"kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-kube-api-access-z7wqm\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:42.921536 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.921511    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 11:52:42.921660 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.921628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bnrml" event={"ID":"d6bdc937-2e58-4ac0-810d-60c58f8a8677","Type":"ContainerStarted","Data":"04c9c9756782687f2babf71d09889b7aeda6c61fa6e80a7f7517028d35ce72f3"}
Jul 16 11:52:42.921961 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.921913    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:52:42.923653 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.923629    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg" event={"ID":"958df694-af55-4f14-aafd-bd38fb2f7f71","Type":"ContainerStarted","Data":"f93b9a024ffc2c9db35dd6a64a1919ba60c5621e6ef21dfac9ce426ee3c33a31"}
Jul 16 11:52:42.923737 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.923680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg" event={"ID":"958df694-af55-4f14-aafd-bd38fb2f7f71","Type":"ContainerStarted","Data":"e30b4185fa011d49142749d04b04e6fc7443647862ae22caecb76e75c2c5c9b4"}
Jul 16 11:52:42.923737 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.923700    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg" event={"ID":"958df694-af55-4f14-aafd-bd38fb2f7f71","Type":"ContainerStarted","Data":"efa98fabfdb4d20e970c585cc88abe0b21cb974810a4997372d35131464fc07a"}
Jul 16 11:52:42.924764 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.924740    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9" event={"ID":"d444a61f-c95d-4831-ad0f-bfe9aa85715c","Type":"ContainerStarted","Data":"0ea8f9bbe786e90599fec5a9a6ca61f114eec67820f74fb063dfd468103ae9b8"}
Jul 16 11:52:42.942690 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:42.942652    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-bnrml" podStartSLOduration=53.794459754 podStartE2EDuration="55.942638667s" totalImagesPullingTime="2.148178913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:42.941949734 +0000 UTC m=+128.056383011" watchObservedRunningTime="2026-07-16 11:52:42.942638667 +0000 UTC m=+128.057071942"
Jul 16 11:52:43.240545 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:43.240442    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-bnrml"
Jul 16 11:52:43.284105 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:43.282936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:43.284105 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:43.284041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:43.541910 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:43.541828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:52:43.781942 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:43.781905    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:43.931578 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:43.931504    2580 generic.go:356] "Generic (PLEG): container finished" podID="e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a" containerID="7505ca4ce5ff2fb713715e9761ab782d6c0c2de3c299d2f91a656aa77523de6f" exitCode=0
Jul 16 11:52:43.932230 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:43.932115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdrf2" event={"ID":"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a","Type":"ContainerDied","Data":"7505ca4ce5ff2fb713715e9761ab782d6c0c2de3c299d2f91a656aa77523de6f"}
Jul 16 11:52:44.033285 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.033203    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:44.108736 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.108708    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 11:52:44.112274 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:44.112021    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c9b7a2_fc4e_423e_ba28_bc7885dfa2b0.slice/crio-b75155aec2c70a734ee198b9594b7ce063804cb6dbbd02cd169a9e2652de0092 WatchSource:0}: Error finding container b75155aec2c70a734ee198b9594b7ce063804cb6dbbd02cd169a9e2652de0092: Status 404 returned error can't find the container with id b75155aec2c70a734ee198b9594b7ce063804cb6dbbd02cd169a9e2652de0092
Jul 16 11:52:44.190655 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.190581    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:44.292631 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.292596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:52:44.294935 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.294912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/174188b1-2017-4842-aa97-2aca4c7af98d-metrics-certs\") pod \"network-metrics-daemon-q5nkv\" (UID: \"174188b1-2017-4842-aa97-2aca4c7af98d\") " pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:52:44.401189 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.401149    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:44.416601 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.416580    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vn7fb\""
Jul 16 11:52:44.423285 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.423269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q5nkv"
Jul 16 11:52:44.445009 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.444953    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7db7488d84-bdxdj"]
Jul 16 11:52:44.449502 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.449483    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.455198 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.455177    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 16 11:52:44.455382 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.455364    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kjt9p\""
Jul 16 11:52:44.455500 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.455441    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 16 11:52:44.455834 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.455815    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3u2s0lq6dq7i0\""
Jul 16 11:52:44.455936 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.455917    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 16 11:52:44.456296 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.456140    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 16 11:52:44.456296 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.456157    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 16 11:52:44.474918 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.474896    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7db7488d84-bdxdj"]
Jul 16 11:52:44.494036 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.493831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w9w7\" (UniqueName: \"kubernetes.io/projected/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-kube-api-access-6w9w7\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.494036 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.493895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-metrics-client-ca\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.494036 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.493931    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-grpc-tls\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.494036 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.493956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.494036 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.494001    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.494408 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.494083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.494408 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.494148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-tls\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.494408 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.494194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.555642 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.555607    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:44.568835 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.568809    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q5nkv"]
Jul 16 11:52:44.573860 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:44.573833    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174188b1_2017_4842_aa97_2aca4c7af98d.slice/crio-92e4d2a1973d6069c410ef02cfb44dba0dde5dbdd0be0d7acbaeb6971fe5b0aa WatchSource:0}: Error finding container 92e4d2a1973d6069c410ef02cfb44dba0dde5dbdd0be0d7acbaeb6971fe5b0aa: Status 404 returned error can't find the container with id 92e4d2a1973d6069c410ef02cfb44dba0dde5dbdd0be0d7acbaeb6971fe5b0aa
Jul 16 11:52:44.594636 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.594614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.594740 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.594654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-tls\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.594740 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.594683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.594740 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.594704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w9w7\" (UniqueName: \"kubernetes.io/projected/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-kube-api-access-6w9w7\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.594740 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.594726    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-metrics-client-ca\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.594866 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.594747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-grpc-tls\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.594866 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.594764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.594866 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.594790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.595868 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.595828    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-metrics-client-ca\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.597498 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.597447    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.598372 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.598350    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-grpc-tls\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.598485 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.598433    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-tls\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.598569 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.598543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.598718 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.598698    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.599206 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.599190    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.606955 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.606934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w9w7\" (UniqueName: \"kubernetes.io/projected/0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe-kube-api-access-6w9w7\") pod \"thanos-querier-7db7488d84-bdxdj\" (UID: \"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe\") " pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.680970 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.680941    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:44.760498 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.760423    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:44.891383 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.891349    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7db7488d84-bdxdj"]
Jul 16 11:52:44.894404 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:44.894374    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bde6178_ef9d_4a91_ba81_6bfaa4c46ebe.slice/crio-1f2d7375c0e85c6bdfb6f6720dfa71b467c41bcfcc8bcb752e79400f5b7d3b32 WatchSource:0}: Error finding container 1f2d7375c0e85c6bdfb6f6720dfa71b467c41bcfcc8bcb752e79400f5b7d3b32: Status 404 returned error can't find the container with id 1f2d7375c0e85c6bdfb6f6720dfa71b467c41bcfcc8bcb752e79400f5b7d3b32
Jul 16 11:52:44.938272 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.938240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdrf2" event={"ID":"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a","Type":"ContainerStarted","Data":"5fe28ea5b0c2d888f1de82df582af83c857e6de8da811751f0260da3572cf604"}
Jul 16 11:52:44.938398 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.938306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hdrf2" event={"ID":"e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a","Type":"ContainerStarted","Data":"171731ecf1176a42ae9b8e1410b840ae21a59cbd72ef107901d819027f4846a0"}
Jul 16 11:52:44.939719 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.939688    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q5nkv" event={"ID":"174188b1-2017-4842-aa97-2aca4c7af98d","Type":"ContainerStarted","Data":"92e4d2a1973d6069c410ef02cfb44dba0dde5dbdd0be0d7acbaeb6971fe5b0aa"}
Jul 16 11:52:44.941246 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.941216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerStarted","Data":"b75155aec2c70a734ee198b9594b7ce063804cb6dbbd02cd169a9e2652de0092"}
Jul 16 11:52:44.942727 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.942703    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj" event={"ID":"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe","Type":"ContainerStarted","Data":"1f2d7375c0e85c6bdfb6f6720dfa71b467c41bcfcc8bcb752e79400f5b7d3b32"}
Jul 16 11:52:44.945761 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.945734    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg" event={"ID":"958df694-af55-4f14-aafd-bd38fb2f7f71","Type":"ContainerStarted","Data":"a5aa16d38259626200f163c1d998707e4669ef0f54717c2919b7b03798fc9c76"}
Jul 16 11:52:44.949034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.949012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9" event={"ID":"d444a61f-c95d-4831-ad0f-bfe9aa85715c","Type":"ContainerStarted","Data":"7102e1b4737a8da0b807fcb373617ea8496fb2e63fbd5afc714e0c10cba4a7b1"}
Jul 16 11:52:44.949140 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.949067    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9" event={"ID":"d444a61f-c95d-4831-ad0f-bfe9aa85715c","Type":"ContainerStarted","Data":"06930f78b20e46ae44c17e6ab6e339f4e96512cfa1b87c09bd0c34aee2c1301a"}
Jul 16 11:52:44.949140 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.949095    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9" event={"ID":"d444a61f-c95d-4831-ad0f-bfe9aa85715c","Type":"ContainerStarted","Data":"959ca466f83b45e28a0745bc71a7e0e6f918aede85ea9b0dafbc2ff1978e6340"}
Jul 16 11:52:44.990723 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.990671    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qfbqg" podStartSLOduration=2.7042996710000002 podStartE2EDuration="3.990654364s" totalImagesPullingTime="1.286354693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:44.99057663 +0000 UTC m=+130.105009906" watchObservedRunningTime="2026-07-16 11:52:44.990654364 +0000 UTC m=+130.105087620"
Jul 16 11:52:44.991537 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:44.991507    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hdrf2" podStartSLOduration=2.7412585 podStartE2EDuration="3.991499571s" totalImagesPullingTime="1.170726976s" totalInitContainerRuntime="79.514095ms" isStatefulPod=true podCreationTimestamp="2026-07-16 11:52:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:44.963287325 +0000 UTC m=+130.077720602" watchObservedRunningTime="2026-07-16 11:52:44.991499571 +0000 UTC m=+130.105932884"
Jul 16 11:52:45.019104 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.018997    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-xb4w9" podStartSLOduration=2.582910741 podStartE2EDuration="4.018981646s" totalImagesPullingTime="1.436070905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:45.018259966 +0000 UTC m=+130.132693241" watchObservedRunningTime="2026-07-16 11:52:45.018981646 +0000 UTC m=+130.133414920"
Jul 16 11:52:45.035212 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.035104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:45.146785 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.146738    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:45.425424 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.425335    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:45.527448 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.527407    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:45.874686 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.874650    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:45.884740 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.884712    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"]
Jul 16 11:52:45.888215 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.888195    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"
Jul 16 11:52:45.891175 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.891150    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tbpbh\""
Jul 16 11:52:45.891268 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.891189    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 16 11:52:45.904025 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.903997    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snw78\" (UniqueName: \"kubernetes.io/projected/5f0f4537-c264-4c7f-ae53-74895ff5d656-kube-api-access-snw78\") pod \"monitoring-plugin-5f68df7f58-6lj7n\" (UID: \"5f0f4537-c264-4c7f-ae53-74895ff5d656\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"
Jul 16 11:52:45.904120 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.904065    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0f4537-c264-4c7f-ae53-74895ff5d656-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6lj7n\" (UID: \"5f0f4537-c264-4c7f-ae53-74895ff5d656\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"
Jul 16 11:52:45.906342 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.906287    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"]
Jul 16 11:52:45.955060 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.954930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q5nkv" event={"ID":"174188b1-2017-4842-aa97-2aca4c7af98d","Type":"ContainerStarted","Data":"b98c95cfce2ebb13aed3ebfd20f7e8acf1681adbd4b2e7d7f49f4d431a771ede"}
Jul 16 11:52:45.955060 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.954988    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q5nkv" event={"ID":"174188b1-2017-4842-aa97-2aca4c7af98d","Type":"ContainerStarted","Data":"64c729ea59b4ca1e146765063bf390c1bff7b864369002c62da7745f36052344"}
Jul 16 11:52:45.956782 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.956754    2580 generic.go:356] "Generic (PLEG): container finished" podID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerID="4dba3fffff6a1fdcdea63204ddc0e517e93a406b67f6aba33babcfdb56bb75bc" exitCode=0
Jul 16 11:52:45.956889 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.956863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerDied","Data":"4dba3fffff6a1fdcdea63204ddc0e517e93a406b67f6aba33babcfdb56bb75bc"}
Jul 16 11:52:45.961623 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.961584    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:45.972528 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:45.972481    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q5nkv" podStartSLOduration=129.897276617 podStartE2EDuration="2m10.972447363s" totalImagesPullingTime="1.075170746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:45.971533708 +0000 UTC m=+131.085966985" watchObservedRunningTime="2026-07-16 11:52:45.972447363 +0000 UTC m=+131.086880641"
Jul 16 11:52:46.005167 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:46.005133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0f4537-c264-4c7f-ae53-74895ff5d656-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6lj7n\" (UID: \"5f0f4537-c264-4c7f-ae53-74895ff5d656\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"
Jul 16 11:52:46.005324 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:46.005297    2580 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 16 11:52:46.005560 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:46.005531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snw78\" (UniqueName: \"kubernetes.io/projected/5f0f4537-c264-4c7f-ae53-74895ff5d656-kube-api-access-snw78\") pod \"monitoring-plugin-5f68df7f58-6lj7n\" (UID: \"5f0f4537-c264-4c7f-ae53-74895ff5d656\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"
Jul 16 11:52:46.006493 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:52:46.006068    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0f4537-c264-4c7f-ae53-74895ff5d656-monitoring-plugin-cert podName:5f0f4537-c264-4c7f-ae53-74895ff5d656 nodeName:}" failed. No retries permitted until 2026-07-16 11:52:46.506044499 +0000 UTC m=+131.620477760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5f0f4537-c264-4c7f-ae53-74895ff5d656-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-6lj7n" (UID: "5f0f4537-c264-4c7f-ae53-74895ff5d656") : secret "monitoring-plugin-cert" not found
Jul 16 11:52:46.014429 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:46.014404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snw78\" (UniqueName: \"kubernetes.io/projected/5f0f4537-c264-4c7f-ae53-74895ff5d656-kube-api-access-snw78\") pod \"monitoring-plugin-5f68df7f58-6lj7n\" (UID: \"5f0f4537-c264-4c7f-ae53-74895ff5d656\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"
Jul 16 11:52:46.067067 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:46.067028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:46.167863 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:46.167815    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:46.296349 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:46.296255    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:46.392764 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:46.392724    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:46.510605 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:46.510554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0f4537-c264-4c7f-ae53-74895ff5d656-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6lj7n\" (UID: \"5f0f4537-c264-4c7f-ae53-74895ff5d656\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"
Jul 16 11:52:46.513565 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:46.513537    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f0f4537-c264-4c7f-ae53-74895ff5d656-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6lj7n\" (UID: \"5f0f4537-c264-4c7f-ae53-74895ff5d656\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"
Jul 16 11:52:46.799852 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:46.799814    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"
Jul 16 11:52:47.646525 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.646497    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"]
Jul 16 11:52:47.650551 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:47.650515    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0f4537_c264_4c7f_ae53_74895ff5d656.slice/crio-362c04213d76cc47473fde05fa93ef717f7204e5fb715cc6bee89574add805d8 WatchSource:0}: Error finding container 362c04213d76cc47473fde05fa93ef717f7204e5fb715cc6bee89574add805d8: Status 404 returned error can't find the container with id 362c04213d76cc47473fde05fa93ef717f7204e5fb715cc6bee89574add805d8
Jul 16 11:52:47.861356 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.861319    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 11:52:47.865118 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.865098    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.867888 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.867851    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:47.869317 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.869297    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4iigb6fq151ni\""
Jul 16 11:52:47.869648 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.869627    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 16 11:52:47.869791 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.869774    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 16 11:52:47.869877 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.869857    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 16 11:52:47.869931 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.869909    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 16 11:52:47.869962 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.869867    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 16 11:52:47.870148 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.870135    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 16 11:52:47.870206 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.870170    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dkwxb\""
Jul 16 11:52:47.870255 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.870182    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 16 11:52:47.870386 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.870369    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 16 11:52:47.870761 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.870743    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 16 11:52:47.870858 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.870780    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 16 11:52:47.871588 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.871573    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 16 11:52:47.874967 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.874948    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 16 11:52:47.875049 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.875021    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 11:52:47.875122 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.875108    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 16 11:52:47.875223 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.875210    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 16 11:52:47.899659 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.899633    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 11:52:47.924156 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924282 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924282 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-web-config\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924282 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924261    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5zpd\" (UniqueName: \"kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-kube-api-access-s5zpd\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924282 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924416 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924309    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924416 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924416 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924565 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924565 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924565 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924565 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924565 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924717 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924717 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924717 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924717 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config-out\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924717 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924717 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.924717 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.924716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:47.968156 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.968125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerStarted","Data":"f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933"}
Jul 16 11:52:47.968309 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.968203    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerStarted","Data":"102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235"}
Jul 16 11:52:47.968309 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.968247    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerStarted","Data":"312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784"}
Jul 16 11:52:47.968309 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.968289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerStarted","Data":"78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82"}
Jul 16 11:52:47.968432 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.968329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerStarted","Data":"8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5"}
Jul 16 11:52:47.969343 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.969323    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n" event={"ID":"5f0f4537-c264-4c7f-ae53-74895ff5d656","Type":"ContainerStarted","Data":"362c04213d76cc47473fde05fa93ef717f7204e5fb715cc6bee89574add805d8"}
Jul 16 11:52:47.971273 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.971250    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj" event={"ID":"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe","Type":"ContainerStarted","Data":"d4d62b38b351a057c8cbfa42e1869ffbf2dad6c1aaab4d196ac5b5682ec53711"}
Jul 16 11:52:47.971363 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.971303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj" event={"ID":"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe","Type":"ContainerStarted","Data":"bf8c8a0ee2d3a9874d6f9f5af1a1d5efcc4630b3ed4ef08aa8f841b741c877f0"}
Jul 16 11:52:47.971363 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:47.971331    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj" event={"ID":"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe","Type":"ContainerStarted","Data":"03ae17c89990f4987416b2405dc02425a884f21c7d2c2b51019f3fb12201d8b7"}
Jul 16 11:52:48.025090 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5zpd\" (UniqueName: \"kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-kube-api-access-s5zpd\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025090 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025043    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025247 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025247 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025247 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025247 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025247 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025247 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config-out\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.025534 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.026305 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025545    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-web-config\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.026305 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.025960    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.026305 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.026112    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.027074 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.027047    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.028523 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.028387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.028523 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.028442    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-web-config\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.028685 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.028592    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.028685 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.028599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config-out\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.028788 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.028739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.029306 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.029182    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.029306 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.029239    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.030052 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.029702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.030052 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.029864    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.030052 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.030006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.030052 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.030015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.030507 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.030489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.030993 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.030973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.031137 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.031119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.031137 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.031130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.031310 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.031292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.038874 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.038855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5zpd\" (UniqueName: \"kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-kube-api-access-s5zpd\") pod \"prometheus-k8s-0\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.174874 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.174840    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:48.350797 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.350768    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 11:52:48.352679 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:52:48.352652    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7da75c_66f5_443f_ab26_6ddd20d15c09.slice/crio-cde30f65b2bbdeed22756328ad88d29954f192c0eb9d8e87d4a41fdde3098fef WatchSource:0}: Error finding container cde30f65b2bbdeed22756328ad88d29954f192c0eb9d8e87d4a41fdde3098fef: Status 404 returned error can't find the container with id cde30f65b2bbdeed22756328ad88d29954f192c0eb9d8e87d4a41fdde3098fef
Jul 16 11:52:48.977035 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.977000    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerID="de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2" exitCode=0
Jul 16 11:52:48.977369 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.977046    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerDied","Data":"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"}
Jul 16 11:52:48.977369 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:48.977109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerStarted","Data":"cde30f65b2bbdeed22756328ad88d29954f192c0eb9d8e87d4a41fdde3098fef"}
Jul 16 11:52:49.982680 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:49.982643    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n" event={"ID":"5f0f4537-c264-4c7f-ae53-74895ff5d656","Type":"ContainerStarted","Data":"91834f5df8713ebbc2baefb9605e26c69158c07f40bdb0552e326ea04bbc48a2"}
Jul 16 11:52:49.983108 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:49.982700    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"
Jul 16 11:52:49.985721 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:49.985693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj" event={"ID":"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe","Type":"ContainerStarted","Data":"5532b69af57294920c7b7d1a44f3706bf97b6314bb884b29d49a61b1c88ad9ed"}
Jul 16 11:52:49.985836 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:49.985763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj" event={"ID":"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe","Type":"ContainerStarted","Data":"fe178eb2bfefeccf4473d9ebef505acd79dcb05de8f60b70e2cff56c63926d89"}
Jul 16 11:52:49.985836 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:49.985805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj" event={"ID":"0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe","Type":"ContainerStarted","Data":"8e8456f05fbb703f15e02a0ae700a770ab7f00817f933832d11ce05dd412f3cb"}
Jul 16 11:52:49.985904 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:49.985852    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:49.987770 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:49.987716    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n"
Jul 16 11:52:50.004305 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:50.004259    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6lj7n" podStartSLOduration=3.631715115 podStartE2EDuration="5.004239968s" totalImagesPullingTime="1.372524853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:50.003727796 +0000 UTC m=+135.118161073" watchObservedRunningTime="2026-07-16 11:52:50.004239968 +0000 UTC m=+135.118673243"
Jul 16 11:52:50.040076 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:50.038577    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj" podStartSLOduration=2.123863479 podStartE2EDuration="6.038556285s" totalImagesPullingTime="3.914692806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:50.037932878 +0000 UTC m=+135.152366153" watchObservedRunningTime="2026-07-16 11:52:50.038556285 +0000 UTC m=+135.152989561"
Jul 16 11:52:51.453770 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:51.453730    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-547b748b65-r7tmb"]
Jul 16 11:52:51.900061 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:51.900023    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:52.015373 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:52.015342    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:53.002866 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:53.002829    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerStarted","Data":"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"}
Jul 16 11:52:53.003285 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:53.002943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerStarted","Data":"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"}
Jul 16 11:52:53.003285 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:53.002977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerStarted","Data":"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"}
Jul 16 11:52:53.003285 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:53.003009    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerStarted","Data":"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"}
Jul 16 11:52:53.003285 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:53.003046    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerStarted","Data":"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"}
Jul 16 11:52:53.003285 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:53.003082    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerStarted","Data":"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"}
Jul 16 11:52:53.005961 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:53.005936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerStarted","Data":"239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857"}
Jul 16 11:52:53.086320 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:53.086259    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.144188109 podStartE2EDuration="6.086239771s" totalImagesPullingTime="2.921896261s" totalInitContainerRuntime="20.155401ms" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:53.085600739 +0000 UTC m=+138.200034014" watchObservedRunningTime="2026-07-16 11:52:53.086239771 +0000 UTC m=+138.200673048"
Jul 16 11:52:53.162565 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:53.162516    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.954576093 podStartE2EDuration="11.162501094s" totalImagesPullingTime="7.189840469s" totalInitContainerRuntime="18.084532ms" isStatefulPod=false podCreationTimestamp="2026-07-16 11:52:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:52:53.155584338 +0000 UTC m=+138.270017635" watchObservedRunningTime="2026-07-16 11:52:53.162501094 +0000 UTC m=+138.276934396"
Jul 16 11:52:53.175454 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:53.175431    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:52:54.856250 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:54.856211    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:55.085573 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:55.085530    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:55.996930 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:55.996898    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7db7488d84-bdxdj"
Jul 16 11:52:57.582896 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:57.582857    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:58.424897 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:58.424860    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:58.527758 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:58.527726    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:58.982046 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:58.982016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:52:59.085351 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:52:59.085316    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:00.978509 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:00.978433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:03.261253 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:03.261210    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:03.454631 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:03.454592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:05.799247 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:05.799200    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:05.915554 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:05.915493    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:05.932652 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:05.932626    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0/init-config-reloader/0.log"
Jul 16 11:53:05.941194 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:05.941164    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0/alertmanager/0.log"
Jul 16 11:53:06.033029 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:06.032992    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0/config-reloader/0.log"
Jul 16 11:53:06.231767 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:06.231740    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0/kube-rbac-proxy-web/0.log"
Jul 16 11:53:06.435143 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:06.435112    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0/kube-rbac-proxy/0.log"
Jul 16 11:53:06.641793 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:06.641766    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0/kube-rbac-proxy-metric/0.log"
Jul 16 11:53:06.833272 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:06.833241    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0/prom-label-proxy/0.log"
Jul 16 11:53:07.234095 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:07.234065    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xb4w9_d444a61f-c95d-4831-ad0f-bfe9aa85715c/kube-state-metrics/0.log"
Jul 16 11:53:07.433325 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:07.433289    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xb4w9_d444a61f-c95d-4831-ad0f-bfe9aa85715c/kube-rbac-proxy-main/0.log"
Jul 16 11:53:07.633876 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:07.633848    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xb4w9_d444a61f-c95d-4831-ad0f-bfe9aa85715c/kube-rbac-proxy-self/0.log"
Jul 16 11:53:08.032039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:08.031966    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-6lj7n_5f0f4537-c264-4c7f-ae53-74895ff5d656/monitoring-plugin/0.log"
Jul 16 11:53:08.835318 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:08.835285    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdrf2_e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a/init-textfile/0.log"
Jul 16 11:53:09.036592 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:09.036562    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdrf2_e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a/node-exporter/0.log"
Jul 16 11:53:09.232374 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:09.232346    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdrf2_e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a/kube-rbac-proxy/0.log"
Jul 16 11:53:10.038345 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:10.038314    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qfbqg_958df694-af55-4f14-aafd-bd38fb2f7f71/kube-rbac-proxy-main/0.log"
Jul 16 11:53:10.281618 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:10.281590    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qfbqg_958df694-af55-4f14-aafd-bd38fb2f7f71/kube-rbac-proxy-self/0.log"
Jul 16 11:53:10.432816 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:10.432779    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qfbqg_958df694-af55-4f14-aafd-bd38fb2f7f71/openshift-state-metrics/0.log"
Jul 16 11:53:10.632794 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:10.632768    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ca7da75c-66f5-443f-ab26-6ddd20d15c09/init-config-reloader/0.log"
Jul 16 11:53:10.838905 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:10.838830    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ca7da75c-66f5-443f-ab26-6ddd20d15c09/prometheus/0.log"
Jul 16 11:53:11.032883 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:11.032857    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ca7da75c-66f5-443f-ab26-6ddd20d15c09/config-reloader/0.log"
Jul 16 11:53:11.233823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:11.233785    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ca7da75c-66f5-443f-ab26-6ddd20d15c09/thanos-sidecar/0.log"
Jul 16 11:53:11.415624 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:11.415574    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:11.433201 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:11.433170    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ca7da75c-66f5-443f-ab26-6ddd20d15c09/kube-rbac-proxy-web/0.log"
Jul 16 11:53:11.513517 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:11.513412    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:11.642578 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:11.642551    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ca7da75c-66f5-443f-ab26-6ddd20d15c09/kube-rbac-proxy/0.log"
Jul 16 11:53:11.833918 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:11.833816    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ca7da75c-66f5-443f-ab26-6ddd20d15c09/kube-rbac-proxy-thanos/0.log"
Jul 16 11:53:12.171144 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:12.171104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:12.280286 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:12.280248    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:12.633845 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:12.633819    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/thanos-query/0.log"
Jul 16 11:53:12.832877 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:12.832844    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/kube-rbac-proxy-web/0.log"
Jul 16 11:53:13.045327 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:13.045244    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/kube-rbac-proxy/0.log"
Jul 16 11:53:13.100033 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:13.099996    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:13.216807 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:13.216769    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:13.232816 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:13.232793    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/prom-label-proxy/0.log"
Jul 16 11:53:13.427568 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:13.427521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:13.433647 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:13.433622    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/kube-rbac-proxy-rules/0.log"
Jul 16 11:53:13.630618 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:13.630568    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:13.640220 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:13.640179    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/kube-rbac-proxy-metrics/0.log"
Jul 16 11:53:13.838354 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:13.838281    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-w5jsz_7bbd90a4-7d2b-4007-b13e-2f871309e7e9/networking-console-plugin/0.log"
Jul 16 11:53:14.035487 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:14.035434    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 11:53:14.243507 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:14.243476    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/3.log"
Jul 16 11:53:16.482853 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.482791    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-547b748b65-r7tmb" podUID="c479f8de-037a-47d2-a6ec-985422170058" containerName="registry" containerID="cri-o://517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7" gracePeriod=30
Jul 16 11:53:16.742321 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.742248    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:53:16.870509 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.870454    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-registry-certificates\") pod \"c479f8de-037a-47d2-a6ec-985422170058\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") "
Jul 16 11:53:16.870664 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.870529    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") pod \"c479f8de-037a-47d2-a6ec-985422170058\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") "
Jul 16 11:53:16.870664 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.870571    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-image-registry-private-configuration\") pod \"c479f8de-037a-47d2-a6ec-985422170058\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") "
Jul 16 11:53:16.870664 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.870628    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-trusted-ca\") pod \"c479f8de-037a-47d2-a6ec-985422170058\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") "
Jul 16 11:53:16.870810 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.870663    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c479f8de-037a-47d2-a6ec-985422170058-ca-trust-extracted\") pod \"c479f8de-037a-47d2-a6ec-985422170058\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") "
Jul 16 11:53:16.870810 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.870690    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-installation-pull-secrets\") pod \"c479f8de-037a-47d2-a6ec-985422170058\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") "
Jul 16 11:53:16.870810 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.870739    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-bound-sa-token\") pod \"c479f8de-037a-47d2-a6ec-985422170058\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") "
Jul 16 11:53:16.870810 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.870802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w68l\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-kube-api-access-2w68l\") pod \"c479f8de-037a-47d2-a6ec-985422170058\" (UID: \"c479f8de-037a-47d2-a6ec-985422170058\") "
Jul 16 11:53:16.871007 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.870862    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c479f8de-037a-47d2-a6ec-985422170058" (UID: "c479f8de-037a-47d2-a6ec-985422170058"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:53:16.871170 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.871120    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c479f8de-037a-47d2-a6ec-985422170058" (UID: "c479f8de-037a-47d2-a6ec-985422170058"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:53:16.871565 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.871392    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-registry-certificates\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:53:16.871565 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.871414    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c479f8de-037a-47d2-a6ec-985422170058-trusted-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:53:16.873639 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.873601    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c479f8de-037a-47d2-a6ec-985422170058" (UID: "c479f8de-037a-47d2-a6ec-985422170058"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:53:16.873776 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.873747    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c479f8de-037a-47d2-a6ec-985422170058" (UID: "c479f8de-037a-47d2-a6ec-985422170058"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:53:16.873954 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.873915    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c479f8de-037a-47d2-a6ec-985422170058" (UID: "c479f8de-037a-47d2-a6ec-985422170058"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:53:16.874054 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.874011    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c479f8de-037a-47d2-a6ec-985422170058" (UID: "c479f8de-037a-47d2-a6ec-985422170058"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:53:16.874391 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.874368    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-kube-api-access-2w68l" (OuterVolumeSpecName: "kube-api-access-2w68l") pod "c479f8de-037a-47d2-a6ec-985422170058" (UID: "c479f8de-037a-47d2-a6ec-985422170058"). InnerVolumeSpecName "kube-api-access-2w68l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:53:16.881244 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.881203    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c479f8de-037a-47d2-a6ec-985422170058-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c479f8de-037a-47d2-a6ec-985422170058" (UID: "c479f8de-037a-47d2-a6ec-985422170058"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:53:16.971835 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.971805    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c479f8de-037a-47d2-a6ec-985422170058-ca-trust-extracted\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:53:16.971835 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.971832    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-installation-pull-secrets\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:53:16.971835 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.971843    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-bound-sa-token\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:53:16.972057 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.971851    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w68l\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-kube-api-access-2w68l\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:53:16.972057 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.971860    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c479f8de-037a-47d2-a6ec-985422170058-registry-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:53:16.972057 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:16.971870    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c479f8de-037a-47d2-a6ec-985422170058-image-registry-private-configuration\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:53:17.103065 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:17.102982    2580 generic.go:356] "Generic (PLEG): container finished" podID="c479f8de-037a-47d2-a6ec-985422170058" containerID="517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7" exitCode=0
Jul 16 11:53:17.103065 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:17.103021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-547b748b65-r7tmb" event={"ID":"c479f8de-037a-47d2-a6ec-985422170058","Type":"ContainerDied","Data":"517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7"}
Jul 16 11:53:17.103237 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:17.103081    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-547b748b65-r7tmb" event={"ID":"c479f8de-037a-47d2-a6ec-985422170058","Type":"ContainerDied","Data":"243b32f5df11eca182f3a210bbab29261e6bce7400dc6a4bd8ec354c29dbd481"}
Jul 16 11:53:17.103237 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:17.103033    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-547b748b65-r7tmb"
Jul 16 11:53:17.103237 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:17.103103    2580 scope.go:117] "RemoveContainer" containerID="517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7"
Jul 16 11:53:17.112390 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:17.112371    2580 scope.go:117] "RemoveContainer" containerID="517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7"
Jul 16 11:53:17.112660 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:53:17.112638    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7\": container with ID starting with 517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7 not found: ID does not exist" containerID="517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7"
Jul 16 11:53:17.112747 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:17.112672    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7"} err="failed to get container status \"517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7\": rpc error: code = NotFound desc = could not find container \"517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7\": container with ID starting with 517efe2ff03c47f19a5b4951ede181d39ccd8e0c1926470eefbe76fdda3fd5e7 not found: ID does not exist"
Jul 16 11:53:17.147050 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:17.147013    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-547b748b65-r7tmb"]
Jul 16 11:53:17.152293 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:17.152270    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-547b748b65-r7tmb"]
Jul 16 11:53:17.401100 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:17.401067    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c479f8de-037a-47d2-a6ec-985422170058" path="/var/lib/kubelet/pods/c479f8de-037a-47d2-a6ec-985422170058/volumes"
Jul 16 11:53:28.403694 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:28.403610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:28.534085 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:28.534052    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:53:48.175516 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:48.175479    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:53:48.194938 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:48.194912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:53:48.250584 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:48.250554    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:53:59.741348 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:53:59.741308    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:54:00.869938 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:00.869903    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:54:00.979229 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:00.979193    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:54:01.917494 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:01.917440    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 11:54:02.290708 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:02.290582    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="alertmanager" containerID="cri-o://8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5" gracePeriod=120
Jul 16 11:54:02.290708 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:02.290635    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy-metric" containerID="cri-o://f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933" gracePeriod=120
Jul 16 11:54:02.290708 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:02.290669    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="config-reloader" containerID="cri-o://78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82" gracePeriod=120
Jul 16 11:54:02.290708 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:02.290669    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy-web" containerID="cri-o://312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784" gracePeriod=120
Jul 16 11:54:02.291033 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:02.290708    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="prom-label-proxy" containerID="cri-o://239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857" gracePeriod=120
Jul 16 11:54:02.291033 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:02.290738    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy" containerID="cri-o://102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235" gracePeriod=120
Jul 16 11:54:03.297710 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.297678    2580 generic.go:356] "Generic (PLEG): container finished" podID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerID="239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857" exitCode=0
Jul 16 11:54:03.297710 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.297702    2580 generic.go:356] "Generic (PLEG): container finished" podID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerID="f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933" exitCode=0
Jul 16 11:54:03.297710 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.297709    2580 generic.go:356] "Generic (PLEG): container finished" podID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerID="102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235" exitCode=0
Jul 16 11:54:03.297710 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.297716    2580 generic.go:356] "Generic (PLEG): container finished" podID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerID="78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82" exitCode=0
Jul 16 11:54:03.297710 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.297721    2580 generic.go:356] "Generic (PLEG): container finished" podID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerID="8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5" exitCode=0
Jul 16 11:54:03.298175 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.297748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerDied","Data":"239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857"}
Jul 16 11:54:03.298175 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.297816    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerDied","Data":"f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933"}
Jul 16 11:54:03.298175 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.297846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerDied","Data":"102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235"}
Jul 16 11:54:03.298175 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.297875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerDied","Data":"78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82"}
Jul 16 11:54:03.298175 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.297902    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerDied","Data":"8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5"}
Jul 16 11:54:03.533334 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.533312    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:03.655098 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655072    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-main-db\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655263 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655110    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-volume\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655263 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655129    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-web-config\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655263 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655263 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655170    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-out\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655263 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655202    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-tls-assets\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655263 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655219    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-main-tls\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655616 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655270    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7wqm\" (UniqueName: \"kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-kube-api-access-z7wqm\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655616 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655301    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-metrics-client-ca\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655616 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655330    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-web\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655616 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655374    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-trusted-ca-bundle\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655616 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655373    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:54:03.655616 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655407    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.655616 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655486    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-cluster-tls-config\") pod \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\" (UID: \"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0\") "
Jul 16 11:54:03.656135 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.655741    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-main-db\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.656453 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.656416    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:03.656743 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.656715    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:03.658483 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.658384    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:03.658826 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.658798    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:03.658915 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.658855    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-volume" (OuterVolumeSpecName: "config-volume") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:03.659225 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.659199    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-kube-api-access-z7wqm" (OuterVolumeSpecName: "kube-api-access-z7wqm") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "kube-api-access-z7wqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:54:03.659980 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.659947    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:03.659980 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.659953    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:54:03.660095 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.660017    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:03.660250 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.660227    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-out" (OuterVolumeSpecName: "config-out") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:54:03.662998 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.662972    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:03.669738 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.669720    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-web-config" (OuterVolumeSpecName: "web-config") pod "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" (UID: "f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:03.756394 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756371    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-tls-assets\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.756394 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756391    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-main-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.756543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756403    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7wqm\" (UniqueName: \"kubernetes.io/projected/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-kube-api-access-z7wqm\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.756543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756413    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-metrics-client-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.756543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756422    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.756543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756431    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.756543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756439    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.756543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756447    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-cluster-tls-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.756543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756472    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-volume\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.756543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756481    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-web-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.756543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756488    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:03.756543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:03.756497    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0-config-out\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:04.305388 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.305342    2580 generic.go:356] "Generic (PLEG): container finished" podID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerID="312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784" exitCode=0
Jul 16 11:54:04.305775 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.305429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerDied","Data":"312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784"}
Jul 16 11:54:04.305775 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.305490    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.305775 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.305533    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0","Type":"ContainerDied","Data":"b75155aec2c70a734ee198b9594b7ce063804cb6dbbd02cd169a9e2652de0092"}
Jul 16 11:54:04.305775 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.305581    2580 scope.go:117] "RemoveContainer" containerID="239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857"
Jul 16 11:54:04.314020 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.313989    2580 scope.go:117] "RemoveContainer" containerID="f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933"
Jul 16 11:54:04.325060 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.325039    2580 scope.go:117] "RemoveContainer" containerID="102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235"
Jul 16 11:54:04.334336 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.334318    2580 scope.go:117] "RemoveContainer" containerID="312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784"
Jul 16 11:54:04.335912 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.335883    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 11:54:04.342961 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.342940    2580 scope.go:117] "RemoveContainer" containerID="78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82"
Jul 16 11:54:04.343206 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.343186    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 11:54:04.349937 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.349922    2580 scope.go:117] "RemoveContainer" containerID="8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5"
Jul 16 11:54:04.356652 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.356637    2580 scope.go:117] "RemoveContainer" containerID="4dba3fffff6a1fdcdea63204ddc0e517e93a406b67f6aba33babcfdb56bb75bc"
Jul 16 11:54:04.369341 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.369323    2580 scope.go:117] "RemoveContainer" containerID="239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857"
Jul 16 11:54:04.369614 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:04.369595    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857\": container with ID starting with 239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857 not found: ID does not exist" containerID="239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857"
Jul 16 11:54:04.369679 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.369621    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857"} err="failed to get container status \"239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857\": rpc error: code = NotFound desc = could not find container \"239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857\": container with ID starting with 239365082dda8896765ca3503b8094a9488787b347270ad2b17e4f9a0988b857 not found: ID does not exist"
Jul 16 11:54:04.369679 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.369638    2580 scope.go:117] "RemoveContainer" containerID="f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933"
Jul 16 11:54:04.369878 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:04.369860    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933\": container with ID starting with f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933 not found: ID does not exist" containerID="f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933"
Jul 16 11:54:04.369917 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.369887    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933"} err="failed to get container status \"f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933\": rpc error: code = NotFound desc = could not find container \"f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933\": container with ID starting with f039ba34d4bfd82244b6dbda7b1e859d2a902761499b14eb9056d7ebe17af933 not found: ID does not exist"
Jul 16 11:54:04.369917 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.369909    2580 scope.go:117] "RemoveContainer" containerID="102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235"
Jul 16 11:54:04.370141 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:04.370122    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235\": container with ID starting with 102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235 not found: ID does not exist" containerID="102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235"
Jul 16 11:54:04.370190 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.370148    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235"} err="failed to get container status \"102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235\": rpc error: code = NotFound desc = could not find container \"102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235\": container with ID starting with 102b79a62ffa6d61e2ee16933ef326f6e2859446ae361667b405ab3706e76235 not found: ID does not exist"
Jul 16 11:54:04.370190 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.370164    2580 scope.go:117] "RemoveContainer" containerID="312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784"
Jul 16 11:54:04.370382 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:04.370367    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784\": container with ID starting with 312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784 not found: ID does not exist" containerID="312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784"
Jul 16 11:54:04.370430 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.370385    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784"} err="failed to get container status \"312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784\": rpc error: code = NotFound desc = could not find container \"312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784\": container with ID starting with 312fe213247f6d681ea8c872c934e164b8269141bf1e66ef649b9d99474d8784 not found: ID does not exist"
Jul 16 11:54:04.370430 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.370397    2580 scope.go:117] "RemoveContainer" containerID="78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82"
Jul 16 11:54:04.370613 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:04.370597    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82\": container with ID starting with 78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82 not found: ID does not exist" containerID="78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82"
Jul 16 11:54:04.370655 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.370616    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82"} err="failed to get container status \"78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82\": rpc error: code = NotFound desc = could not find container \"78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82\": container with ID starting with 78f27585e64a5fea43f3f8734ce99dcc86bf1f56ee2016119891651d4751db82 not found: ID does not exist"
Jul 16 11:54:04.370655 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.370628    2580 scope.go:117] "RemoveContainer" containerID="8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5"
Jul 16 11:54:04.370818 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:04.370802    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5\": container with ID starting with 8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5 not found: ID does not exist" containerID="8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5"
Jul 16 11:54:04.370857 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.370821    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5"} err="failed to get container status \"8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5\": rpc error: code = NotFound desc = could not find container \"8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5\": container with ID starting with 8e3dd217cc9c26f5acfa4bc18cdf580f9015385f8a7c95a7423b00314008b9d5 not found: ID does not exist"
Jul 16 11:54:04.370857 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.370834    2580 scope.go:117] "RemoveContainer" containerID="4dba3fffff6a1fdcdea63204ddc0e517e93a406b67f6aba33babcfdb56bb75bc"
Jul 16 11:54:04.371023 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:04.371003    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dba3fffff6a1fdcdea63204ddc0e517e93a406b67f6aba33babcfdb56bb75bc\": container with ID starting with 4dba3fffff6a1fdcdea63204ddc0e517e93a406b67f6aba33babcfdb56bb75bc not found: ID does not exist" containerID="4dba3fffff6a1fdcdea63204ddc0e517e93a406b67f6aba33babcfdb56bb75bc"
Jul 16 11:54:04.371064 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.371028    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dba3fffff6a1fdcdea63204ddc0e517e93a406b67f6aba33babcfdb56bb75bc"} err="failed to get container status \"4dba3fffff6a1fdcdea63204ddc0e517e93a406b67f6aba33babcfdb56bb75bc\": rpc error: code = NotFound desc = could not find container \"4dba3fffff6a1fdcdea63204ddc0e517e93a406b67f6aba33babcfdb56bb75bc\": container with ID starting with 4dba3fffff6a1fdcdea63204ddc0e517e93a406b67f6aba33babcfdb56bb75bc not found: ID does not exist"
Jul 16 11:54:04.384840 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.384815    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 11:54:04.385121 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385110    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy"
Jul 16 11:54:04.385160 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385123    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy"
Jul 16 11:54:04.385160 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385134    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c479f8de-037a-47d2-a6ec-985422170058" containerName="registry"
Jul 16 11:54:04.385160 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385140    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c479f8de-037a-47d2-a6ec-985422170058" containerName="registry"
Jul 16 11:54:04.385160 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385153    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy-metric"
Jul 16 11:54:04.385160 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385160    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy-metric"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385169    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="init-config-reloader"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385175    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="init-config-reloader"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385181    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy-web"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385186    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy-web"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385191    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="prom-label-proxy"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385196    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="prom-label-proxy"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385202    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="alertmanager"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385207    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="alertmanager"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385215    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="config-reloader"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385220    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="config-reloader"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385259    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="alertmanager"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385266    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="prom-label-proxy"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385271    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="config-reloader"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385277    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy-web"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385284    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385290    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c479f8de-037a-47d2-a6ec-985422170058" containerName="registry"
Jul 16 11:54:04.385302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.385297    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" containerName="kube-rbac-proxy-metric"
Jul 16 11:54:04.390226 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.390210    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.395202 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.395164    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 16 11:54:04.395724 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.395694    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 16 11:54:04.395833 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.395816    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cg8c9\""
Jul 16 11:54:04.396721 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.396692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 16 11:54:04.396721 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.396714    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 16 11:54:04.396862 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.396737    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 16 11:54:04.396862 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.396776    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 16 11:54:04.396934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.396866    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 16 11:54:04.397112 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.397096    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 16 11:54:04.403414 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.403391    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 16 11:54:04.409610 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.409588    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 11:54:04.462357 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462444 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462444 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462444 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-web-config\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462601 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-config-volume\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462601 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vknk2\" (UniqueName: \"kubernetes.io/projected/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-kube-api-access-vknk2\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462601 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462601 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462546    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462734 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462734 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-config-out\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462734 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462655    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462734 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.462734 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.462695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.563908 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.563836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.563908 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.563871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.563908 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.563891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.564109 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.563916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-web-config\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.564164 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.564122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-config-volume\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.564217 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.564166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vknk2\" (UniqueName: \"kubernetes.io/projected/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-kube-api-access-vknk2\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.564217 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.564209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.564566 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.564425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.564566 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.564517    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.564566 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.564552    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-config-out\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.564753 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.564584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.564753 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.564623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.564753 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.564661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.565094 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.565034    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.565921 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.565899    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.566831 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.566801    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.567330 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.567045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.567330 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.567172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.567330 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.567280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-config-volume\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.567330 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.567321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.567657 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.567636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.568689 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.568663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-config-out\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.568846 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.568830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-web-config\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.568984 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.568967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.569491 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.569448    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.572766 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.572749    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vknk2\" (UniqueName: \"kubernetes.io/projected/54c0ae30-d444-4960-8ce5-5958f2f5d0ee-kube-api-access-vknk2\") pod \"alertmanager-main-0\" (UID: \"54c0ae30-d444-4960-8ce5-5958f2f5d0ee\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.699716 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.699677    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 16 11:54:04.842288 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:04.842264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 16 11:54:04.844320 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:54:04.844287    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c0ae30_d444_4960_8ce5_5958f2f5d0ee.slice/crio-e61a08870b1c1b12cbde9a506c721f34830cde161296b6e3b90325147a30c3b6 WatchSource:0}: Error finding container e61a08870b1c1b12cbde9a506c721f34830cde161296b6e3b90325147a30c3b6: Status 404 returned error can't find the container with id e61a08870b1c1b12cbde9a506c721f34830cde161296b6e3b90325147a30c3b6
Jul 16 11:54:05.310431 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:05.310395    2580 generic.go:356] "Generic (PLEG): container finished" podID="54c0ae30-d444-4960-8ce5-5958f2f5d0ee" containerID="c0f5372e138dd0cdab4299de773f2c7d19badbb8cc48957bca5f6cfa19bf0dec" exitCode=0
Jul 16 11:54:05.310900 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:05.310487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c0ae30-d444-4960-8ce5-5958f2f5d0ee","Type":"ContainerDied","Data":"c0f5372e138dd0cdab4299de773f2c7d19badbb8cc48957bca5f6cfa19bf0dec"}
Jul 16 11:54:05.310900 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:05.310551    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c0ae30-d444-4960-8ce5-5958f2f5d0ee","Type":"ContainerStarted","Data":"e61a08870b1c1b12cbde9a506c721f34830cde161296b6e3b90325147a30c3b6"}
Jul 16 11:54:05.400892 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:05.400835    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0" path="/var/lib/kubelet/pods/f1c9b7a2-fc4e-423e-ba28-bc7885dfa2b0/volumes"
Jul 16 11:54:06.239592 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.239550    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 11:54:06.239929 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.239892    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="prometheus" containerID="cri-o://c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d" gracePeriod=600
Jul 16 11:54:06.240064 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.239922    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy" containerID="cri-o://826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e" gracePeriod=600
Jul 16 11:54:06.240064 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.239960    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy-thanos" containerID="cri-o://43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398" gracePeriod=600
Jul 16 11:54:06.240064 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.239966    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="thanos-sidecar" containerID="cri-o://0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972" gracePeriod=600
Jul 16 11:54:06.240064 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.239974    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="config-reloader" containerID="cri-o://a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a" gracePeriod=600
Jul 16 11:54:06.240064 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.239975    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy-web" containerID="cri-o://f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6" gracePeriod=600
Jul 16 11:54:06.318669 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.318639    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c0ae30-d444-4960-8ce5-5958f2f5d0ee","Type":"ContainerStarted","Data":"1c11701268e1780f25b5e622f0b75326e0fef0685682547fec7805a66b4fe42c"}
Jul 16 11:54:06.318987 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.318702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c0ae30-d444-4960-8ce5-5958f2f5d0ee","Type":"ContainerStarted","Data":"2062355b9936ce6c7794ba1df7d0e5904699cbd07cc8e3f49639449757914666"}
Jul 16 11:54:06.318987 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.318728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c0ae30-d444-4960-8ce5-5958f2f5d0ee","Type":"ContainerStarted","Data":"6534eb35fa2b1699068a167983f7e7c002add3ce3226b127497d6feab7048e2b"}
Jul 16 11:54:06.318987 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.318752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c0ae30-d444-4960-8ce5-5958f2f5d0ee","Type":"ContainerStarted","Data":"108244aa3b488f7d682dd3a2e3f35bf88045ea5ce53ca2fc339d82ebb1a15f12"}
Jul 16 11:54:06.318987 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.318779    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c0ae30-d444-4960-8ce5-5958f2f5d0ee","Type":"ContainerStarted","Data":"ee1424bafec0ca5b4b5fe9a603b5684cf99000c1c48a39199d6930e70167e1fa"}
Jul 16 11:54:06.318987 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.318802    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c0ae30-d444-4960-8ce5-5958f2f5d0ee","Type":"ContainerStarted","Data":"3e791fca583865f90c69c3b4deefefe1195b525bb5a3ea2128433fadf47463e2"}
Jul 16 11:54:06.348308 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.348241    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.328523861 podStartE2EDuration="2.348219909s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.696048ms" isStatefulPod=false podCreationTimestamp="2026-07-16 11:54:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:54:06.346318765 +0000 UTC m=+211.460752056" watchObservedRunningTime="2026-07-16 11:54:06.348219909 +0000 UTC m=+211.462653186"
Jul 16 11:54:06.491296 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.491242    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:06.584397 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.584363    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-0\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.584578 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.584411    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5zpd\" (UniqueName: \"kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-kube-api-access-s5zpd\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.584578 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.584436    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-grpc-tls\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.584578 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.584482    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-thanos-prometheus-http-client-file\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.584578 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.584511    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-kube-rbac-proxy\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.584578 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.584543    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.584578 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.584572    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-db\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.584912 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.584598    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config-out\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.584979 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.584952    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-2\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585005    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-trusted-ca-bundle\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585092 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585039    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-serving-certs-ca-bundle\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585092 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585076    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-web-config\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585190 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585117    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-metrics-client-certs\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585190 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585151    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-tls\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585190 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-kubelet-serving-ca-bundle\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585323 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585212    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-tls-assets\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585323 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585260    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585323 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585280    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-1\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585323 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585311    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585544 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585351    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-metrics-client-ca\") pod \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\" (UID: \"ca7da75c-66f5-443f-ab26-6ddd20d15c09\") "
Jul 16 11:54:06.585633 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585560    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:06.585896 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585868    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:06.585970 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.585931    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:06.586263 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.586236    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:06.586754 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.586722    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:06.587083 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.587021    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:06.587221 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.587158    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 11:54:06.587287 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.587228    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:54:06.587346 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.587294    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:06.588125 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.588096    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:06.588807 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.588781    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:06.589012 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.588916    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config-out" (OuterVolumeSpecName: "config-out") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 11:54:06.589113 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.589067    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-kube-api-access-s5zpd" (OuterVolumeSpecName: "kube-api-access-s5zpd") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "kube-api-access-s5zpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:54:06.589267 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.589248    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:06.589673 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.589650    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:06.589760 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.589720    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 11:54:06.590166 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.590149    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:06.590230 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.590173    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config" (OuterVolumeSpecName: "config") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:06.590411 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.590393    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:06.602439 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.602407    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-web-config" (OuterVolumeSpecName: "web-config") pod "ca7da75c-66f5-443f-ab26-6ddd20d15c09" (UID: "ca7da75c-66f5-443f-ab26-6ddd20d15c09"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 11:54:06.686178 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686148    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-metrics-client-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686178 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686174    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686178 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686183    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5zpd\" (UniqueName: \"kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-kube-api-access-s5zpd\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686192    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-grpc-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686201    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686210    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-kube-rbac-proxy\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686219    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686227    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-db\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686235    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config-out\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686243    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686250    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686258    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686267    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-web-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686274    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-metrics-client-certs\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686282    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686292    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686300    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ca7da75c-66f5-443f-ab26-6ddd20d15c09-tls-assets\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686309    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-config\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686316    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ca7da75c-66f5-443f-ab26-6ddd20d15c09-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:06.686379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:06.686324    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ca7da75c-66f5-443f-ab26-6ddd20d15c09-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 11:54:07.325374 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325343    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerID="43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398" exitCode=0
Jul 16 11:54:07.325374 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325368    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerID="826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e" exitCode=0
Jul 16 11:54:07.325374 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325374    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerID="f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6" exitCode=0
Jul 16 11:54:07.325374 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325380    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerID="0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972" exitCode=0
Jul 16 11:54:07.325934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325387    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerID="a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a" exitCode=0
Jul 16 11:54:07.325934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325392    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerID="c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d" exitCode=0
Jul 16 11:54:07.325934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325416    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.325934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerDied","Data":"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"}
Jul 16 11:54:07.325934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerDied","Data":"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"}
Jul 16 11:54:07.325934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerDied","Data":"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"}
Jul 16 11:54:07.325934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325583    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerDied","Data":"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"}
Jul 16 11:54:07.325934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325598    2580 scope.go:117] "RemoveContainer" containerID="43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"
Jul 16 11:54:07.325934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerDied","Data":"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"}
Jul 16 11:54:07.325934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325660    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerDied","Data":"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"}
Jul 16 11:54:07.325934 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.325703    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ca7da75c-66f5-443f-ab26-6ddd20d15c09","Type":"ContainerDied","Data":"cde30f65b2bbdeed22756328ad88d29954f192c0eb9d8e87d4a41fdde3098fef"}
Jul 16 11:54:07.334074 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.334055    2580 scope.go:117] "RemoveContainer" containerID="826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"
Jul 16 11:54:07.341133 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.341116    2580 scope.go:117] "RemoveContainer" containerID="f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"
Jul 16 11:54:07.351133 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.351115    2580 scope.go:117] "RemoveContainer" containerID="0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"
Jul 16 11:54:07.355632 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.355598    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 11:54:07.358941 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.358911    2580 scope.go:117] "RemoveContainer" containerID="a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"
Jul 16 11:54:07.362797 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.362773    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 11:54:07.369293 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.369272    2580 scope.go:117] "RemoveContainer" containerID="c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"
Jul 16 11:54:07.376703 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.376687    2580 scope.go:117] "RemoveContainer" containerID="de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"
Jul 16 11:54:07.383348 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.383329    2580 scope.go:117] "RemoveContainer" containerID="43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"
Jul 16 11:54:07.383636 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:07.383617    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": container with ID starting with 43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398 not found: ID does not exist" containerID="43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"
Jul 16 11:54:07.383700 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.383644    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"} err="failed to get container status \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": rpc error: code = NotFound desc = could not find container \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": container with ID starting with 43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398 not found: ID does not exist"
Jul 16 11:54:07.383700 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.383664    2580 scope.go:117] "RemoveContainer" containerID="826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"
Jul 16 11:54:07.383944 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:07.383923    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": container with ID starting with 826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e not found: ID does not exist" containerID="826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"
Jul 16 11:54:07.383987 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.383948    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"} err="failed to get container status \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": rpc error: code = NotFound desc = could not find container \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": container with ID starting with 826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e not found: ID does not exist"
Jul 16 11:54:07.383987 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.383964    2580 scope.go:117] "RemoveContainer" containerID="f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"
Jul 16 11:54:07.384191 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:07.384177    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": container with ID starting with f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6 not found: ID does not exist" containerID="f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"
Jul 16 11:54:07.384235 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.384194    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"} err="failed to get container status \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": rpc error: code = NotFound desc = could not find container \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": container with ID starting with f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6 not found: ID does not exist"
Jul 16 11:54:07.384235 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.384205    2580 scope.go:117] "RemoveContainer" containerID="0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"
Jul 16 11:54:07.384407 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:07.384393    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": container with ID starting with 0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972 not found: ID does not exist" containerID="0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"
Jul 16 11:54:07.384445 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.384409    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"} err="failed to get container status \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": rpc error: code = NotFound desc = could not find container \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": container with ID starting with 0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972 not found: ID does not exist"
Jul 16 11:54:07.384445 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.384420    2580 scope.go:117] "RemoveContainer" containerID="a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"
Jul 16 11:54:07.384670 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:07.384652    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": container with ID starting with a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a not found: ID does not exist" containerID="a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"
Jul 16 11:54:07.384710 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.384674    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"} err="failed to get container status \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": rpc error: code = NotFound desc = could not find container \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": container with ID starting with a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a not found: ID does not exist"
Jul 16 11:54:07.384710 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.384688    2580 scope.go:117] "RemoveContainer" containerID="c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"
Jul 16 11:54:07.384893 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:07.384879    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": container with ID starting with c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d not found: ID does not exist" containerID="c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"
Jul 16 11:54:07.384936 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.384895    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"} err="failed to get container status \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": rpc error: code = NotFound desc = could not find container \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": container with ID starting with c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d not found: ID does not exist"
Jul 16 11:54:07.384936 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.384909    2580 scope.go:117] "RemoveContainer" containerID="de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"
Jul 16 11:54:07.385082 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:54:07.385068    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": container with ID starting with de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2 not found: ID does not exist" containerID="de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"
Jul 16 11:54:07.385117 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.385084    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"} err="failed to get container status \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": rpc error: code = NotFound desc = could not find container \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": container with ID starting with de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2 not found: ID does not exist"
Jul 16 11:54:07.385117 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.385095    2580 scope.go:117] "RemoveContainer" containerID="43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"
Jul 16 11:54:07.385294 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.385280    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"} err="failed to get container status \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": rpc error: code = NotFound desc = could not find container \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": container with ID starting with 43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398 not found: ID does not exist"
Jul 16 11:54:07.385335 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.385294    2580 scope.go:117] "RemoveContainer" containerID="826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"
Jul 16 11:54:07.385439 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.385426    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"} err="failed to get container status \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": rpc error: code = NotFound desc = could not find container \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": container with ID starting with 826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e not found: ID does not exist"
Jul 16 11:54:07.385439 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.385438    2580 scope.go:117] "RemoveContainer" containerID="f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"
Jul 16 11:54:07.385643 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.385625    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"} err="failed to get container status \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": rpc error: code = NotFound desc = could not find container \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": container with ID starting with f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6 not found: ID does not exist"
Jul 16 11:54:07.385705 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.385646    2580 scope.go:117] "RemoveContainer" containerID="0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"
Jul 16 11:54:07.385847 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.385829    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"} err="failed to get container status \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": rpc error: code = NotFound desc = could not find container \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": container with ID starting with 0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972 not found: ID does not exist"
Jul 16 11:54:07.385916 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.385848    2580 scope.go:117] "RemoveContainer" containerID="a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"
Jul 16 11:54:07.386034 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386014    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"} err="failed to get container status \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": rpc error: code = NotFound desc = could not find container \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": container with ID starting with a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a not found: ID does not exist"
Jul 16 11:54:07.386092 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386035    2580 scope.go:117] "RemoveContainer" containerID="c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"
Jul 16 11:54:07.386243 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386225    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"} err="failed to get container status \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": rpc error: code = NotFound desc = could not find container \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": container with ID starting with c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d not found: ID does not exist"
Jul 16 11:54:07.386304 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386244    2580 scope.go:117] "RemoveContainer" containerID="de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"
Jul 16 11:54:07.386427 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386411    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"} err="failed to get container status \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": rpc error: code = NotFound desc = could not find container \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": container with ID starting with de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2 not found: ID does not exist"
Jul 16 11:54:07.386497 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386427    2580 scope.go:117] "RemoveContainer" containerID="43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"
Jul 16 11:54:07.386600 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386583    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"} err="failed to get container status \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": rpc error: code = NotFound desc = could not find container \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": container with ID starting with 43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398 not found: ID does not exist"
Jul 16 11:54:07.386644 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386602    2580 scope.go:117] "RemoveContainer" containerID="826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"
Jul 16 11:54:07.386812 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386797    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"} err="failed to get container status \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": rpc error: code = NotFound desc = could not find container \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": container with ID starting with 826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e not found: ID does not exist"
Jul 16 11:54:07.386850 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386811    2580 scope.go:117] "RemoveContainer" containerID="f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"
Jul 16 11:54:07.386999 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386984    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"} err="failed to get container status \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": rpc error: code = NotFound desc = could not find container \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": container with ID starting with f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6 not found: ID does not exist"
Jul 16 11:54:07.386999 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.386997    2580 scope.go:117] "RemoveContainer" containerID="0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"
Jul 16 11:54:07.387167 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.387151    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"} err="failed to get container status \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": rpc error: code = NotFound desc = could not find container \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": container with ID starting with 0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972 not found: ID does not exist"
Jul 16 11:54:07.387167 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.387166    2580 scope.go:117] "RemoveContainer" containerID="a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"
Jul 16 11:54:07.387330 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.387316    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"} err="failed to get container status \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": rpc error: code = NotFound desc = could not find container \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": container with ID starting with a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a not found: ID does not exist"
Jul 16 11:54:07.387330 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.387329    2580 scope.go:117] "RemoveContainer" containerID="c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"
Jul 16 11:54:07.387503 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.387489    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"} err="failed to get container status \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": rpc error: code = NotFound desc = could not find container \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": container with ID starting with c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d not found: ID does not exist"
Jul 16 11:54:07.387547 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.387503    2580 scope.go:117] "RemoveContainer" containerID="de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"
Jul 16 11:54:07.387691 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.387677    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"} err="failed to get container status \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": rpc error: code = NotFound desc = could not find container \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": container with ID starting with de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2 not found: ID does not exist"
Jul 16 11:54:07.387691 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.387691    2580 scope.go:117] "RemoveContainer" containerID="43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"
Jul 16 11:54:07.387869 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.387856    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"} err="failed to get container status \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": rpc error: code = NotFound desc = could not find container \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": container with ID starting with 43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398 not found: ID does not exist"
Jul 16 11:54:07.387869 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.387868    2580 scope.go:117] "RemoveContainer" containerID="826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"
Jul 16 11:54:07.388094 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.388074    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"} err="failed to get container status \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": rpc error: code = NotFound desc = could not find container \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": container with ID starting with 826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e not found: ID does not exist"
Jul 16 11:54:07.388132 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.388095    2580 scope.go:117] "RemoveContainer" containerID="f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"
Jul 16 11:54:07.388286 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.388271    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"} err="failed to get container status \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": rpc error: code = NotFound desc = could not find container \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": container with ID starting with f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6 not found: ID does not exist"
Jul 16 11:54:07.388326 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.388285    2580 scope.go:117] "RemoveContainer" containerID="0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"
Jul 16 11:54:07.388437 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.388423    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"} err="failed to get container status \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": rpc error: code = NotFound desc = could not find container \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": container with ID starting with 0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972 not found: ID does not exist"
Jul 16 11:54:07.388508 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.388436    2580 scope.go:117] "RemoveContainer" containerID="a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"
Jul 16 11:54:07.388681 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.388654    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"} err="failed to get container status \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": rpc error: code = NotFound desc = could not find container \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": container with ID starting with a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a not found: ID does not exist"
Jul 16 11:54:07.388719 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.388681    2580 scope.go:117] "RemoveContainer" containerID="c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"
Jul 16 11:54:07.388874 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.388858    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"} err="failed to get container status \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": rpc error: code = NotFound desc = could not find container \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": container with ID starting with c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d not found: ID does not exist"
Jul 16 11:54:07.388874 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.388873    2580 scope.go:117] "RemoveContainer" containerID="de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"
Jul 16 11:54:07.389098 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.389081    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"} err="failed to get container status \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": rpc error: code = NotFound desc = could not find container \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": container with ID starting with de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2 not found: ID does not exist"
Jul 16 11:54:07.389141 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.389098    2580 scope.go:117] "RemoveContainer" containerID="43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"
Jul 16 11:54:07.389319 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.389303    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"} err="failed to get container status \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": rpc error: code = NotFound desc = could not find container \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": container with ID starting with 43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398 not found: ID does not exist"
Jul 16 11:54:07.389357 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.389319    2580 scope.go:117] "RemoveContainer" containerID="826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"
Jul 16 11:54:07.389543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.389520    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"} err="failed to get container status \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": rpc error: code = NotFound desc = could not find container \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": container with ID starting with 826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e not found: ID does not exist"
Jul 16 11:54:07.389543 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.389542    2580 scope.go:117] "RemoveContainer" containerID="f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"
Jul 16 11:54:07.389761 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.389743    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"} err="failed to get container status \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": rpc error: code = NotFound desc = could not find container \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": container with ID starting with f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6 not found: ID does not exist"
Jul 16 11:54:07.389761 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.389761    2580 scope.go:117] "RemoveContainer" containerID="0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"
Jul 16 11:54:07.389994 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.389974    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"} err="failed to get container status \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": rpc error: code = NotFound desc = could not find container \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": container with ID starting with 0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972 not found: ID does not exist"
Jul 16 11:54:07.390043 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.389995    2580 scope.go:117] "RemoveContainer" containerID="a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"
Jul 16 11:54:07.390194 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.390176    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"} err="failed to get container status \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": rpc error: code = NotFound desc = could not find container \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": container with ID starting with a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a not found: ID does not exist"
Jul 16 11:54:07.390241 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.390195    2580 scope.go:117] "RemoveContainer" containerID="c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"
Jul 16 11:54:07.390416 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.390385    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"} err="failed to get container status \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": rpc error: code = NotFound desc = could not find container \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": container with ID starting with c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d not found: ID does not exist"
Jul 16 11:54:07.390416 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.390416    2580 scope.go:117] "RemoveContainer" containerID="de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"
Jul 16 11:54:07.390661 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.390642    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"} err="failed to get container status \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": rpc error: code = NotFound desc = could not find container \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": container with ID starting with de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2 not found: ID does not exist"
Jul 16 11:54:07.390661 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.390661    2580 scope.go:117] "RemoveContainer" containerID="43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"
Jul 16 11:54:07.390872 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.390851    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398"} err="failed to get container status \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": rpc error: code = NotFound desc = could not find container \"43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398\": container with ID starting with 43cfe72f139864333745135071e832aa60f8c79760f92882ae3dcd23a6519398 not found: ID does not exist"
Jul 16 11:54:07.390923 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.390873    2580 scope.go:117] "RemoveContainer" containerID="826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"
Jul 16 11:54:07.391041 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.391025    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e"} err="failed to get container status \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": rpc error: code = NotFound desc = could not find container \"826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e\": container with ID starting with 826e923399a55f54a0ec9e7efa7954b5a6cedaa1dd90e92be4c7da847f3b8f3e not found: ID does not exist"
Jul 16 11:54:07.391081 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.391041    2580 scope.go:117] "RemoveContainer" containerID="f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"
Jul 16 11:54:07.391269 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.391252    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6"} err="failed to get container status \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": rpc error: code = NotFound desc = could not find container \"f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6\": container with ID starting with f2e55f5b105e918ce010936da33bdf260e83fbb294f766ff600f85cf40f5c4a6 not found: ID does not exist"
Jul 16 11:54:07.391269 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.391267    2580 scope.go:117] "RemoveContainer" containerID="0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"
Jul 16 11:54:07.391488 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.391447    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972"} err="failed to get container status \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": rpc error: code = NotFound desc = could not find container \"0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972\": container with ID starting with 0b0b87f8dfce6d518dc379765d306afd3065cd53b47a858b1cfbe19e85865972 not found: ID does not exist"
Jul 16 11:54:07.391562 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.391490    2580 scope.go:117] "RemoveContainer" containerID="a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"
Jul 16 11:54:07.391908 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.391874    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a"} err="failed to get container status \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": rpc error: code = NotFound desc = could not find container \"a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a\": container with ID starting with a08640da10b6d817094aff0e0d37c46d30b218ca807ee81c0bbd377af7235c5a not found: ID does not exist"
Jul 16 11:54:07.391908 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.391907    2580 scope.go:117] "RemoveContainer" containerID="c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"
Jul 16 11:54:07.392168 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.392147    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d"} err="failed to get container status \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": rpc error: code = NotFound desc = could not find container \"c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d\": container with ID starting with c0d6a2fc0f27ed7dd76654b2fbb6029e34e4b1b4d8ff6f369344d8839f036e0d not found: ID does not exist"
Jul 16 11:54:07.392215 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.392169    2580 scope.go:117] "RemoveContainer" containerID="de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"
Jul 16 11:54:07.392417 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.392402    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2"} err="failed to get container status \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": rpc error: code = NotFound desc = could not find container \"de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2\": container with ID starting with de2bf4d5217f84cc074d166ebbfef9b03e5a451c4d40dc68b2e17c7ed494cdf2 not found: ID does not exist"
Jul 16 11:54:07.399311 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.399291    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" path="/var/lib/kubelet/pods/ca7da75c-66f5-443f-ab26-6ddd20d15c09/volumes"
Jul 16 11:54:07.409518 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409444    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 11:54:07.409761 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409747    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="thanos-sidecar"
Jul 16 11:54:07.409802 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409764    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="thanos-sidecar"
Jul 16 11:54:07.409802 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409775    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy"
Jul 16 11:54:07.409802 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409781    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy"
Jul 16 11:54:07.409802 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409791    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="prometheus"
Jul 16 11:54:07.409802 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409796    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="prometheus"
Jul 16 11:54:07.409802 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409803    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="config-reloader"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409808    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="config-reloader"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409819    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="init-config-reloader"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409825    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="init-config-reloader"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409831    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy-web"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409836    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy-web"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409842    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy-thanos"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409847    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy-thanos"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409893    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="thanos-sidecar"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409902    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy-web"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409908    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy-thanos"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409914    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="config-reloader"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409920    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="prometheus"
Jul 16 11:54:07.409971 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.409925    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca7da75c-66f5-443f-ab26-6ddd20d15c09" containerName="kube-rbac-proxy"
Jul 16 11:54:07.415026 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.415006    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.420501 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.420481    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 16 11:54:07.420695 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.420674    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 16 11:54:07.420818 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.420680    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 16 11:54:07.420818 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.420710    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 16 11:54:07.420931 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.420900    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 16 11:54:07.421016 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.420945    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 16 11:54:07.421016 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.420975    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 16 11:54:07.421016 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.421007    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 16 11:54:07.421172 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.421100    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 16 11:54:07.421172 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.421103    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 16 11:54:07.421661 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.421641    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dkwxb\""
Jul 16 11:54:07.421954 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.421939    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 16 11:54:07.422083 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.421961    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 16 11:54:07.422083 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.421987    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 16 11:54:07.422083 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.421939    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4iigb6fq151ni\""
Jul 16 11:54:07.423303 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.423285    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 16 11:54:07.453046 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.453013    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 16 11:54:07.454697 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.454676    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 11:54:07.492797 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.492766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.492950 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.492805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.492950 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.492822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.492950 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.492855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.492950 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.492916    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493078 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.492952    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493078 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.492978    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493078 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-config\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493078 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493078 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493219 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493219 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-755ph\" (UniqueName: \"kubernetes.io/projected/0d484815-0c7b-45b8-b868-69f4b3289e88-kube-api-access-755ph\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493219 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493166    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493219 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493327 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493218    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493327 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d484815-0c7b-45b8-b868-69f4b3289e88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493327 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d484815-0c7b-45b8-b868-69f4b3289e88-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493327 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493433 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.493433 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.493358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.594279 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.594279 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.594279 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594249    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.594523 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.594570 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.594675 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.594791 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.594791 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.594913 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.594913 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594857    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.594913 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595067 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-config\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595067 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595067 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595067 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.594985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595067 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.595035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595067 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.595057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-755ph\" (UniqueName: \"kubernetes.io/projected/0d484815-0c7b-45b8-b868-69f4b3289e88-kube-api-access-755ph\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595392 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.595087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595392 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.595116    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595392 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.595145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595392 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.595160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595392 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.595180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d484815-0c7b-45b8-b868-69f4b3289e88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595392 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.595208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d484815-0c7b-45b8-b868-69f4b3289e88-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.595891 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.595871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.596102 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.596017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.597188 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.597165    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.597590 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.597568    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.597754 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.597728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.598580 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.598558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d484815-0c7b-45b8-b868-69f4b3289e88-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.598801 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.598749    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-config\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.599219 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.599200    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d484815-0c7b-45b8-b868-69f4b3289e88-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.600202 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.599632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d484815-0c7b-45b8-b868-69f4b3289e88-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.600332 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.599912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.600402 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.600149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.600445 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.600430    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.600657 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.600639    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.600724 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.600704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.601014 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.600994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.601316 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.601299    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d484815-0c7b-45b8-b868-69f4b3289e88-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.605379 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.605363    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-755ph\" (UniqueName: \"kubernetes.io/projected/0d484815-0c7b-45b8-b868-69f4b3289e88-kube-api-access-755ph\") pod \"prometheus-k8s-0\" (UID: \"0d484815-0c7b-45b8-b868-69f4b3289e88\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.725116 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.725083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:07.863386 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:07.863315    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 16 11:54:07.866036 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:54:07.866006    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d484815_0c7b_45b8_b868_69f4b3289e88.slice/crio-9d4f65d34448c44f1cfb6569fcacef923dafcc16f60166154dc331581d7a61ed WatchSource:0}: Error finding container 9d4f65d34448c44f1cfb6569fcacef923dafcc16f60166154dc331581d7a61ed: Status 404 returned error can't find the container with id 9d4f65d34448c44f1cfb6569fcacef923dafcc16f60166154dc331581d7a61ed
Jul 16 11:54:08.331940 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:08.331892    2580 generic.go:356] "Generic (PLEG): container finished" podID="0d484815-0c7b-45b8-b868-69f4b3289e88" containerID="ec5e443459e3626232de60e919fe2a340f1bddb124fa0532aeaccb660589a626" exitCode=0
Jul 16 11:54:08.332356 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:08.331993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d484815-0c7b-45b8-b868-69f4b3289e88","Type":"ContainerDied","Data":"ec5e443459e3626232de60e919fe2a340f1bddb124fa0532aeaccb660589a626"}
Jul 16 11:54:08.332356 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:08.332077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d484815-0c7b-45b8-b868-69f4b3289e88","Type":"ContainerStarted","Data":"9d4f65d34448c44f1cfb6569fcacef923dafcc16f60166154dc331581d7a61ed"}
Jul 16 11:54:09.340614 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:09.340580    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d484815-0c7b-45b8-b868-69f4b3289e88","Type":"ContainerStarted","Data":"a55e94500b72a25ebe5a820697668e9a02f7cd4e43b6360a28d6000269a3fe5d"}
Jul 16 11:54:09.341041 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:09.340655    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d484815-0c7b-45b8-b868-69f4b3289e88","Type":"ContainerStarted","Data":"e5bea737f7c2ea062c98472ac11a309cce64d90421dcb5c664ea77b191e0974a"}
Jul 16 11:54:09.341041 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:09.340696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d484815-0c7b-45b8-b868-69f4b3289e88","Type":"ContainerStarted","Data":"815a63de0bbe90b1af254801e41fc2d22374b0bfdebb30c08a63885c2e2a2545"}
Jul 16 11:54:09.341041 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:09.340736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d484815-0c7b-45b8-b868-69f4b3289e88","Type":"ContainerStarted","Data":"ab6b041b2a5e9333b393500bc5592feacfa2d74e9bf3a42b9a7bc087707d5b84"}
Jul 16 11:54:09.341041 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:09.340779    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d484815-0c7b-45b8-b868-69f4b3289e88","Type":"ContainerStarted","Data":"14a019cadb46024ad86715f51f31c6452c828535f467a6473408d41f0b1745ad"}
Jul 16 11:54:09.341041 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:09.340818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d484815-0c7b-45b8-b868-69f4b3289e88","Type":"ContainerStarted","Data":"a15d74451ac19a31de72e6278fa9f34c789f48557e629700f276a6fdf57cba6c"}
Jul 16 11:54:09.377225 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:09.377143    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.358179098 podStartE2EDuration="2.377127325s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.948227ms" isStatefulPod=false podCreationTimestamp="2026-07-16 11:54:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:54:09.374201689 +0000 UTC m=+214.488635001" watchObservedRunningTime="2026-07-16 11:54:09.377127325 +0000 UTC m=+214.491560601"
Jul 16 11:54:11.635367 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:11.635330    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:54:11.709327 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:11.709296    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:54:12.725223 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:12.725188    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:54:23.021235 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:23.021197    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:54:23.121509 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:23.121474    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:54:23.239374 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:23.239336    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:54:35.988472 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:35.988421    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:54:36.047020 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:54:36.046985    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:55:07.725395 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:07.725300    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:55:07.741815 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:07.741789    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:55:08.593060 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:08.593034    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 16 11:55:16.184047 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:16.184016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:55:16.293055 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:16.293028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:55:17.274751 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:17.274682    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:55:17.376496 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:17.376439    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:55:28.226684 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:28.226644    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:55:28.308310 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:28.308277    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:55:28.406834 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:28.406795    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:55:28.480916 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:28.480822    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:55:35.315561 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:35.315532    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 11:55:35.319203 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:35.319171    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 11:55:35.320624 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:35.320602    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 11:55:35.324554 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:35.324535    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 11:55:35.326041 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:35.326023    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 11:55:43.429646 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:43.429606    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:55:43.530333 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:55:43.530279    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:12.195129 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:12.195092    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:22.383133 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:22.383094    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:22.491289 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:22.491251    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:41.690048 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:41.689941    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:49.734294 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:49.734253    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:50.063004 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:50.062892    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:53.507976 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:53.507936    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:53.599604 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:53.599567    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:54.881670 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:54.881639    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:55.118932 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:55.118900    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:55.513307 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:55.513275    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:55.725276 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:55.725233    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:57.603839 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:57.603802    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:58.007368 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:58.007326    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:59.687670 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:59.687633    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:56:59.795154 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:56:59.795107    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:02.114676 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.114645    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq"]
Jul 16 11:57:02.118047 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.118030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq"
Jul 16 11:57:02.120901 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.120875    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zd75v\""
Jul 16 11:57:02.121735 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.121717    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 11:57:02.121841 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.121767    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 11:57:02.131180 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.131155    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq"]
Jul 16 11:57:02.258580 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.258538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39366d36-e8f2-45e8-b19c-2359d33c14d7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gvxgq\" (UID: \"39366d36-e8f2-45e8-b19c-2359d33c14d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq"
Jul 16 11:57:02.258580 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.258584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzf2r\" (UniqueName: \"kubernetes.io/projected/39366d36-e8f2-45e8-b19c-2359d33c14d7-kube-api-access-pzf2r\") pod \"cert-manager-cainjector-559cdd8c87-gvxgq\" (UID: \"39366d36-e8f2-45e8-b19c-2359d33c14d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq"
Jul 16 11:57:02.359468 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.359420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39366d36-e8f2-45e8-b19c-2359d33c14d7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gvxgq\" (UID: \"39366d36-e8f2-45e8-b19c-2359d33c14d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq"
Jul 16 11:57:02.359616 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.359501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzf2r\" (UniqueName: \"kubernetes.io/projected/39366d36-e8f2-45e8-b19c-2359d33c14d7-kube-api-access-pzf2r\") pod \"cert-manager-cainjector-559cdd8c87-gvxgq\" (UID: \"39366d36-e8f2-45e8-b19c-2359d33c14d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq"
Jul 16 11:57:02.378149 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.378079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39366d36-e8f2-45e8-b19c-2359d33c14d7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gvxgq\" (UID: \"39366d36-e8f2-45e8-b19c-2359d33c14d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq"
Jul 16 11:57:02.378280 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.378175    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzf2r\" (UniqueName: \"kubernetes.io/projected/39366d36-e8f2-45e8-b19c-2359d33c14d7-kube-api-access-pzf2r\") pod \"cert-manager-cainjector-559cdd8c87-gvxgq\" (UID: \"39366d36-e8f2-45e8-b19c-2359d33c14d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq"
Jul 16 11:57:02.427127 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.427101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq"
Jul 16 11:57:02.572761 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.572735    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq"]
Jul 16 11:57:02.575338 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:57:02.575313    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39366d36_e8f2_45e8_b19c_2359d33c14d7.slice/crio-3ca8ef7b580330dfe34a1be2afeb394c04306d836f6fb3f7b40dc8bf57318a95 WatchSource:0}: Error finding container 3ca8ef7b580330dfe34a1be2afeb394c04306d836f6fb3f7b40dc8bf57318a95: Status 404 returned error can't find the container with id 3ca8ef7b580330dfe34a1be2afeb394c04306d836f6fb3f7b40dc8bf57318a95
Jul 16 11:57:02.577302 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:02.577286    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 11:57:03.012787 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:03.012752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq" event={"ID":"39366d36-e8f2-45e8-b19c-2359d33c14d7","Type":"ContainerStarted","Data":"3ca8ef7b580330dfe34a1be2afeb394c04306d836f6fb3f7b40dc8bf57318a95"}
Jul 16 11:57:05.733285 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:05.733189    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:06.028609 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:06.028511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq" event={"ID":"39366d36-e8f2-45e8-b19c-2359d33c14d7","Type":"ContainerStarted","Data":"821c4d7195778b1237153fd725dcb1ae431c9d510a9cc9cf58d5d3ed2e747d37"}
Jul 16 11:57:06.043988 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:06.043931    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gvxgq" podStartSLOduration=1.180282345 podStartE2EDuration="4.043917618s" totalImagesPullingTime="2.863635273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:57:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:57:06.043074694 +0000 UTC m=+391.157507970" watchObservedRunningTime="2026-07-16 11:57:06.043917618 +0000 UTC m=+391.158350894"
Jul 16 11:57:06.239567 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:06.239532    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:06.331670 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:06.331578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:07.409403 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:07.409368    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:07.517868 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:07.517833    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:09.214720 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:09.214684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:12.521988 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:12.521951    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:12.688361 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:12.688332    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:14.249299 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:14.249263    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:26.074017 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:26.073955    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:30.481138 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:30.481099    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:30.619634 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:30.619607    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:30.951886 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:30.951844    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:31.216048 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.215942    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:31.339132 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.339099    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:31.439313 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.439284    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"]
Jul 16 11:57:31.442778 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.442763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.446855 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.446836    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 11:57:31.447099 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.447082    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 11:57:31.448216 ip-10-0-137-84 kubenswrapper[2580]: E0716 11:57:31.448190    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-zvkj4\" is forbidden: User \"system:node:ip-10-0-137-84.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-84.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zvkj4\"" type="*v1.Secret"
Jul 16 11:57:31.448422 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.448407    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 11:57:31.448529 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.448476    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 11:57:31.513611 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.513550    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"]
Jul 16 11:57:31.589039 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.589004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv58m\" (UniqueName: \"kubernetes.io/projected/83546b63-438f-4901-bfe6-a1f4e07c76f7-kube-api-access-sv58m\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.589180 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.589047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83546b63-438f-4901-bfe6-a1f4e07c76f7-tmp\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.589180 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.589078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83546b63-438f-4901-bfe6-a1f4e07c76f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.589180 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.589105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83546b63-438f-4901-bfe6-a1f4e07c76f7-manifests\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.589180 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.589134    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83546b63-438f-4901-bfe6-a1f4e07c76f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.690201 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.690164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83546b63-438f-4901-bfe6-a1f4e07c76f7-manifests\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.690201 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.690203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83546b63-438f-4901-bfe6-a1f4e07c76f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.690383 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.690288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv58m\" (UniqueName: \"kubernetes.io/projected/83546b63-438f-4901-bfe6-a1f4e07c76f7-kube-api-access-sv58m\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.690383 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.690322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83546b63-438f-4901-bfe6-a1f4e07c76f7-tmp\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.690383 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.690367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83546b63-438f-4901-bfe6-a1f4e07c76f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.690668 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.690647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/83546b63-438f-4901-bfe6-a1f4e07c76f7-manifests\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.692870 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.692846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83546b63-438f-4901-bfe6-a1f4e07c76f7-tmp\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.693069 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.693051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/83546b63-438f-4901-bfe6-a1f4e07c76f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.693116 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.693054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/83546b63-438f-4901-bfe6-a1f4e07c76f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.697477 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.697434    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:31.700312 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.700288    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv58m\" (UniqueName: \"kubernetes.io/projected/83546b63-438f-4901-bfe6-a1f4e07c76f7-kube-api-access-sv58m\") pod \"opendatahub-operator-controller-manager-57d7447f8f-zr8nj\" (UID: \"83546b63-438f-4901-bfe6-a1f4e07c76f7\") " pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:31.819942 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.819853    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:31.982733 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:31.982697    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:32.129694 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:32.129645    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:32.259406 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:32.259373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:32.685088 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:32.685056    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zvkj4\""
Jul 16 11:57:32.694406 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:32.694384    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:32.874152 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:32.874078    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"]
Jul 16 11:57:32.876316 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:57:32.876289    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83546b63_438f_4901_bfe6_a1f4e07c76f7.slice/crio-c3528f1dfa54cbd89b5b0532efb3c9e89442a6bb4cf7d347e6fb06e2b51f060f WatchSource:0}: Error finding container c3528f1dfa54cbd89b5b0532efb3c9e89442a6bb4cf7d347e6fb06e2b51f060f: Status 404 returned error can't find the container with id c3528f1dfa54cbd89b5b0532efb3c9e89442a6bb4cf7d347e6fb06e2b51f060f
Jul 16 11:57:33.134726 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:33.134691    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj" event={"ID":"83546b63-438f-4901-bfe6-a1f4e07c76f7","Type":"ContainerStarted","Data":"c3528f1dfa54cbd89b5b0532efb3c9e89442a6bb4cf7d347e6fb06e2b51f060f"}
Jul 16 11:57:36.151300 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:36.151259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj" event={"ID":"83546b63-438f-4901-bfe6-a1f4e07c76f7","Type":"ContainerStarted","Data":"6bd04a5c9856fd0dbb6d8d0953ad9378a0a36c3fe9e159eef5e5e5835177f21c"}
Jul 16 11:57:37.157134 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:37.157105    2580 generic.go:356] "Generic (PLEG): container finished" podID="83546b63-438f-4901-bfe6-a1f4e07c76f7" containerID="6bd04a5c9856fd0dbb6d8d0953ad9378a0a36c3fe9e159eef5e5e5835177f21c" exitCode=0
Jul 16 11:57:37.157532 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:37.157169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj" event={"ID":"83546b63-438f-4901-bfe6-a1f4e07c76f7","Type":"ContainerDied","Data":"6bd04a5c9856fd0dbb6d8d0953ad9378a0a36c3fe9e159eef5e5e5835177f21c"}
Jul 16 11:57:38.162821 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:38.162784    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj" event={"ID":"83546b63-438f-4901-bfe6-a1f4e07c76f7","Type":"ContainerStarted","Data":"bdd347cb2ed625d1e344cdfa31e8f95d47959e0348c46b5fe45fd98f573aae97"}
Jul 16 11:57:38.163221 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:38.162939    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:38.197434 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:38.197380    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj" podStartSLOduration=2.614159173 podStartE2EDuration="7.197366691s" totalImagesPullingTime="3.541299607s" totalInitContainerRuntime="1.041907911s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:57:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:57:38.196243971 +0000 UTC m=+423.310677246" watchObservedRunningTime="2026-07-16 11:57:38.197366691 +0000 UTC m=+423.311800034"
Jul 16 11:57:38.605537 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:38.605433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:38.738837 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:38.738798    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:42.635291 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:42.635227    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:42.730880 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:42.730837    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:49.169850 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:49.169812    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57d7447f8f-zr8nj"
Jul 16 11:57:51.268673 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:51.268638    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:51.432927 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:51.432891    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:52.094437 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:52.094401    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:52.369951 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:52.369856    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:52.533267 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:52.533232    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:52.764523 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:52.764487    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:52.923825 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:52.923792    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:53.112931 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:53.112828    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:53.654194 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:53.654157    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:54.005790 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:54.005690    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:54.692094 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:54.692049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:54.834417 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:54.834385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:57:56.104178 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:57:56.104136    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:00.529744 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:00.529645    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:00.758124 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:00.758089    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:00.953339 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:00.953309    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86477779b7-487sx"]
Jul 16 11:58:00.960026 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:00.960004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:00.965375 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:00.965354    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 11:58:00.966515 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:00.966235    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 16 11:58:00.966515 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:00.966289    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bp976\""
Jul 16 11:58:00.966515 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:00.966331    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 16 11:58:00.966704 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:00.966621    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 16 11:58:00.966704 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:00.966658    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 11:58:00.988778 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:00.988755    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86477779b7-487sx"]
Jul 16 11:58:01.024013 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.023986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzfs6\" (UniqueName: \"kubernetes.io/projected/8b921cda-7844-4215-a71f-08db57094bcd-kube-api-access-tzfs6\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.024132 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.024018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b921cda-7844-4215-a71f-08db57094bcd-metrics-cert\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.024132 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.024051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b921cda-7844-4215-a71f-08db57094bcd-cert\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.024132 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.024110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8b921cda-7844-4215-a71f-08db57094bcd-manager-config\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.098594 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.098566    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"]
Jul 16 11:58:01.107217 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.107197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.111728 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.111706    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 11:58:01.115040 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.115018    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 11:58:01.115165 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.115143    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 11:58:01.115240 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.115184    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 11:58:01.115240 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.115156    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 11:58:01.115542 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.115523    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jn9q7\""
Jul 16 11:58:01.115628 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.115523    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 11:58:01.125340 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.125318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8b921cda-7844-4215-a71f-08db57094bcd-manager-config\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.125420 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.125373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzfs6\" (UniqueName: \"kubernetes.io/projected/8b921cda-7844-4215-a71f-08db57094bcd-kube-api-access-tzfs6\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.125516 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.125496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b921cda-7844-4215-a71f-08db57094bcd-metrics-cert\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.125600 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.125583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b921cda-7844-4215-a71f-08db57094bcd-cert\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.126041 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.126018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8b921cda-7844-4215-a71f-08db57094bcd-manager-config\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.127942 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.127926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b921cda-7844-4215-a71f-08db57094bcd-cert\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.128004 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.127990    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b921cda-7844-4215-a71f-08db57094bcd-metrics-cert\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.140874 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.140850    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"]
Jul 16 11:58:01.164953 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.164928    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzfs6\" (UniqueName: \"kubernetes.io/projected/8b921cda-7844-4215-a71f-08db57094bcd-kube-api-access-tzfs6\") pod \"lws-controller-manager-86477779b7-487sx\" (UID: \"8b921cda-7844-4215-a71f-08db57094bcd\") " pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.210775 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.210714    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:01.226451 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.226423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/376fbe01-9407-4f41-b517-5148c3875851-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.226582 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.226480    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn8kz\" (UniqueName: \"kubernetes.io/projected/376fbe01-9407-4f41-b517-5148c3875851-kube-api-access-mn8kz\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.226582 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.226532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/376fbe01-9407-4f41-b517-5148c3875851-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.226582 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.226554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/376fbe01-9407-4f41-b517-5148c3875851-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.226582 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.226578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376fbe01-9407-4f41-b517-5148c3875851-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.226739 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.226646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/376fbe01-9407-4f41-b517-5148c3875851-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.226739 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.226704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/376fbe01-9407-4f41-b517-5148c3875851-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.269347 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.269320    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:01.314980 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.314948    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:01.327989 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.327926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn8kz\" (UniqueName: \"kubernetes.io/projected/376fbe01-9407-4f41-b517-5148c3875851-kube-api-access-mn8kz\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.328125 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.328004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/376fbe01-9407-4f41-b517-5148c3875851-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.328125 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.328040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/376fbe01-9407-4f41-b517-5148c3875851-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.328125 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.328075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376fbe01-9407-4f41-b517-5148c3875851-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.328279 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.328125    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/376fbe01-9407-4f41-b517-5148c3875851-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.328279 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.328178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/376fbe01-9407-4f41-b517-5148c3875851-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.328279 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.328212    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/376fbe01-9407-4f41-b517-5148c3875851-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.330029 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.329969    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/376fbe01-9407-4f41-b517-5148c3875851-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.331425 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.331388    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/376fbe01-9407-4f41-b517-5148c3875851-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.331554 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.331530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/376fbe01-9407-4f41-b517-5148c3875851-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.331710 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.331689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/376fbe01-9407-4f41-b517-5148c3875851-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.332007 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.331987    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/376fbe01-9407-4f41-b517-5148c3875851-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.339823 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.339803    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn8kz\" (UniqueName: \"kubernetes.io/projected/376fbe01-9407-4f41-b517-5148c3875851-kube-api-access-mn8kz\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.341185 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.341167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376fbe01-9407-4f41-b517-5148c3875851-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rl8xp\" (UID: \"376fbe01-9407-4f41-b517-5148c3875851\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.411491 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.411447    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86477779b7-487sx"]
Jul 16 11:58:01.414507 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:58:01.414453    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b921cda_7844_4215_a71f_08db57094bcd.slice/crio-b1ebbd51568dbf180bd74e5b88505359098d677199cd22cb848088397593036f WatchSource:0}: Error finding container b1ebbd51568dbf180bd74e5b88505359098d677199cd22cb848088397593036f: Status 404 returned error can't find the container with id b1ebbd51568dbf180bd74e5b88505359098d677199cd22cb848088397593036f
Jul 16 11:58:01.416235 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.416218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:01.419628 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.419607    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:01.580532 ip-10-0-137-84 kubenswrapper[2580]: W0716 11:58:01.580502    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376fbe01_9407_4f41_b517_5148c3875851.slice/crio-75fe366c6930bbf6d0d52f6bf7fcd52f6e35f34d66dbde5ec605db34dd42f8b7 WatchSource:0}: Error finding container 75fe366c6930bbf6d0d52f6bf7fcd52f6e35f34d66dbde5ec605db34dd42f8b7: Status 404 returned error can't find the container with id 75fe366c6930bbf6d0d52f6bf7fcd52f6e35f34d66dbde5ec605db34dd42f8b7
Jul 16 11:58:01.588414 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:01.588392    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"]
Jul 16 11:58:02.271527 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:02.271490    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp" event={"ID":"376fbe01-9407-4f41-b517-5148c3875851","Type":"ContainerStarted","Data":"75fe366c6930bbf6d0d52f6bf7fcd52f6e35f34d66dbde5ec605db34dd42f8b7"}
Jul 16 11:58:02.273320 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:02.273292    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx" event={"ID":"8b921cda-7844-4215-a71f-08db57094bcd","Type":"ContainerStarted","Data":"b1ebbd51568dbf180bd74e5b88505359098d677199cd22cb848088397593036f"}
Jul 16 11:58:04.861825 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:04.861552    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 11:58:04.861825 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:04.861809    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 11:58:05.290655 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.290616    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:05.295611 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.294699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx" event={"ID":"8b921cda-7844-4215-a71f-08db57094bcd","Type":"ContainerStarted","Data":"87bf9d793e70442e72f5a42f4f54259a3840e5ab2d1281b3a88207db6df625e4"}
Jul 16 11:58:05.295611 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.295561    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:05.300659 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.298829    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp" event={"ID":"376fbe01-9407-4f41-b517-5148c3875851","Type":"ContainerStarted","Data":"122e6f4d594a86baefe75130a49e099dcc7b4fba0cfffea8375f8f815702e826"}
Jul 16 11:58:05.300659 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.300490    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:05.303321 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.301308    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-rl8xp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 11:58:05.303321 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.301355    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp" podUID="376fbe01-9407-4f41-b517-5148c3875851" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 11:58:05.327937 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.327874    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx" podStartSLOduration=1.884143775 podStartE2EDuration="5.327802214s" totalImagesPullingTime="3.443658439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:58:05.326541162 +0000 UTC m=+450.440974439" watchObservedRunningTime="2026-07-16 11:58:05.327802214 +0000 UTC m=+450.442235500"
Jul 16 11:58:05.368540 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.368484    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp" podStartSLOduration=1.090312995 podStartE2EDuration="4.368450254s" totalImagesPullingTime="3.278137259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 11:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 11:58:05.365910145 +0000 UTC m=+450.480343420" watchObservedRunningTime="2026-07-16 11:58:05.368450254 +0000 UTC m=+450.482883537"
Jul 16 11:58:05.433549 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.433504    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:05.529080 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.529047    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:05.715106 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.715076    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:05.891662 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:05.891611    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:06.305803 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:06.305764    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-rl8xp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 11:58:06.306003 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:06.305825    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp" podUID="376fbe01-9407-4f41-b517-5148c3875851" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 11:58:07.310321 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:07.310293    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rl8xp"
Jul 16 11:58:17.312403 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:17.312360    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86477779b7-487sx"
Jul 16 11:58:40.798236 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:40.798197    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:42.720330 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:42.720296    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:42.873135 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:42.873077    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:52.829844 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:52.829784    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:53.040748 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:53.040712    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:58:53.351677 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:58:53.351628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:21.240956 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:21.240916    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:22.599720 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:22.599680    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:26.014743 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:26.014702    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:27.590689 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:27.590602    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:28.024445 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:28.024404    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:28.672695 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:28.672656    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:28.836519 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:28.836483    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:30.649541 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:30.649507    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:32.678531 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:32.678454    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:33.442769 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:33.442735    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:34.948556 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:34.948520    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:37.305191 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:37.305136    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:37.506596 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:37.506563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:37.845402 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:37.845368    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:38.012510 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:38.012441    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:43.479109 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:43.479072    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:43.593830 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:43.593799    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:47.615308 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:47.615273    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:47.876693 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:47.876599    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:48.154322 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:48.154290    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:50.116310 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:50.116276    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:50.628517 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:50.628479    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:54.738954 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:54.738914    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:55.012293 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:55.012212    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:59.101915 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:59.101879    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 11:59:59.251349 ip-10-0-137-84 kubenswrapper[2580]: I0716 11:59:59.251313    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:08.193439 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:08.193395    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:08.298664 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:08.298612    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:10.721830 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:10.721796    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:10.858677 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:10.858636    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:15.696131 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:15.696098    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:15.847088 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:15.847051    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:27.374285 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:27.374249    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:27.809664 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:27.809628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:29.964550 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:29.964515    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fk94m"]
Jul 16 12:00:29.967699 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:29.967681    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:29.971261 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:29.971241    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xm2kv\""
Jul 16 12:00:29.971361 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:29.971241    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 12:00:29.972064 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:29.972047    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 12:00:29.972148 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:29.972133    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 12:00:29.983279 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:29.983260    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fk94m"]
Jul 16 12:00:30.020493 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.020451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4a56367-a9a2-4f75-924f-68e0d3af3767-config-file\") pod \"limitador-limitador-64c94fd64f-fk94m\" (UID: \"b4a56367-a9a2-4f75-924f-68e0d3af3767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:30.020645 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.020519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knfq8\" (UniqueName: \"kubernetes.io/projected/b4a56367-a9a2-4f75-924f-68e0d3af3767-kube-api-access-knfq8\") pod \"limitador-limitador-64c94fd64f-fk94m\" (UID: \"b4a56367-a9a2-4f75-924f-68e0d3af3767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:30.054570 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.054532    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fk94m"]
Jul 16 12:00:30.121363 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.121335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4a56367-a9a2-4f75-924f-68e0d3af3767-config-file\") pod \"limitador-limitador-64c94fd64f-fk94m\" (UID: \"b4a56367-a9a2-4f75-924f-68e0d3af3767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:30.121541 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.121376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knfq8\" (UniqueName: \"kubernetes.io/projected/b4a56367-a9a2-4f75-924f-68e0d3af3767-kube-api-access-knfq8\") pod \"limitador-limitador-64c94fd64f-fk94m\" (UID: \"b4a56367-a9a2-4f75-924f-68e0d3af3767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:30.121940 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.121921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4a56367-a9a2-4f75-924f-68e0d3af3767-config-file\") pod \"limitador-limitador-64c94fd64f-fk94m\" (UID: \"b4a56367-a9a2-4f75-924f-68e0d3af3767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:30.132794 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.132774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knfq8\" (UniqueName: \"kubernetes.io/projected/b4a56367-a9a2-4f75-924f-68e0d3af3767-kube-api-access-knfq8\") pod \"limitador-limitador-64c94fd64f-fk94m\" (UID: \"b4a56367-a9a2-4f75-924f-68e0d3af3767\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:30.277714 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.277639    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:30.377515 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.377479    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:30.417375 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.417259    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fk94m"]
Jul 16 12:00:30.420115 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:00:30.420091    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a56367_a9a2_4f75_924f_68e0d3af3767.slice/crio-91414649e62d08c5da71c9d3506e8c81b6cb51582eaf338355695af297f18e8b WatchSource:0}: Error finding container 91414649e62d08c5da71c9d3506e8c81b6cb51582eaf338355695af297f18e8b: Status 404 returned error can't find the container with id 91414649e62d08c5da71c9d3506e8c81b6cb51582eaf338355695af297f18e8b
Jul 16 12:00:30.575146 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.575061    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:30.946946 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:30.946915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m" event={"ID":"b4a56367-a9a2-4f75-924f-68e0d3af3767","Type":"ContainerStarted","Data":"91414649e62d08c5da71c9d3506e8c81b6cb51582eaf338355695af297f18e8b"}
Jul 16 12:00:31.027192 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:31.027156    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:31.173212 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:31.173177    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:33.962510 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:33.962444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m" event={"ID":"b4a56367-a9a2-4f75-924f-68e0d3af3767","Type":"ContainerStarted","Data":"a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107"}
Jul 16 12:00:33.962971 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:33.962531    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:35.348110 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:35.348078    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:00:35.349611 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:35.349579    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:00:35.354931 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:35.354909    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:00:35.356092 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:35.356073    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:00:41.721315 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:41.721270    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:44.967996 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:44.967964    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:45.006609 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:45.006556    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m" podStartSLOduration=12.835697788000001 podStartE2EDuration="16.006540158s" totalImagesPullingTime="3.17084237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:00:33.992401319 +0000 UTC m=+599.106834594" watchObservedRunningTime="2026-07-16 12:00:45.006540158 +0000 UTC m=+610.120973433"
Jul 16 12:00:48.003444 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:48.003409    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:48.676739 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:48.676700    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fk94m"]
Jul 16 12:00:48.676914 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:48.676889    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m" podUID="b4a56367-a9a2-4f75-924f-68e0d3af3767" containerName="limitador" containerID="cri-o://a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107" gracePeriod=30
Jul 16 12:00:49.223816 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:49.223790    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:49.285666 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:49.285586    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4a56367-a9a2-4f75-924f-68e0d3af3767-config-file\") pod \"b4a56367-a9a2-4f75-924f-68e0d3af3767\" (UID: \"b4a56367-a9a2-4f75-924f-68e0d3af3767\") "
Jul 16 12:00:49.285666 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:49.285638    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knfq8\" (UniqueName: \"kubernetes.io/projected/b4a56367-a9a2-4f75-924f-68e0d3af3767-kube-api-access-knfq8\") pod \"b4a56367-a9a2-4f75-924f-68e0d3af3767\" (UID: \"b4a56367-a9a2-4f75-924f-68e0d3af3767\") "
Jul 16 12:00:49.285928 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:49.285905    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4a56367-a9a2-4f75-924f-68e0d3af3767-config-file" (OuterVolumeSpecName: "config-file") pod "b4a56367-a9a2-4f75-924f-68e0d3af3767" (UID: "b4a56367-a9a2-4f75-924f-68e0d3af3767"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:00:49.287931 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:49.287908    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4a56367-a9a2-4f75-924f-68e0d3af3767-kube-api-access-knfq8" (OuterVolumeSpecName: "kube-api-access-knfq8") pod "b4a56367-a9a2-4f75-924f-68e0d3af3767" (UID: "b4a56367-a9a2-4f75-924f-68e0d3af3767"). InnerVolumeSpecName "kube-api-access-knfq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:00:49.386479 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:49.386430    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knfq8\" (UniqueName: \"kubernetes.io/projected/b4a56367-a9a2-4f75-924f-68e0d3af3767-kube-api-access-knfq8\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:00:49.386643 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:49.386486    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b4a56367-a9a2-4f75-924f-68e0d3af3767-config-file\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:00:50.040843 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:50.040805    2580 generic.go:356] "Generic (PLEG): container finished" podID="b4a56367-a9a2-4f75-924f-68e0d3af3767" containerID="a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107" exitCode=0
Jul 16 12:00:50.041044 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:50.040853    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m"
Jul 16 12:00:50.041044 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:50.040887    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m" event={"ID":"b4a56367-a9a2-4f75-924f-68e0d3af3767","Type":"ContainerDied","Data":"a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107"}
Jul 16 12:00:50.041044 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:50.040957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fk94m" event={"ID":"b4a56367-a9a2-4f75-924f-68e0d3af3767","Type":"ContainerDied","Data":"91414649e62d08c5da71c9d3506e8c81b6cb51582eaf338355695af297f18e8b"}
Jul 16 12:00:50.041044 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:50.040979    2580 scope.go:117] "RemoveContainer" containerID="a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107"
Jul 16 12:00:50.049401 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:50.049384    2580 scope.go:117] "RemoveContainer" containerID="a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107"
Jul 16 12:00:50.049675 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:00:50.049652    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107\": container with ID starting with a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107 not found: ID does not exist" containerID="a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107"
Jul 16 12:00:50.049773 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:50.049681    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107"} err="failed to get container status \"a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107\": rpc error: code = NotFound desc = could not find container \"a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107\": container with ID starting with a773356914357e67db91b8a31c8ca77e7753ae3efb2abafc6fc43e519dd0f107 not found: ID does not exist"
Jul 16 12:00:50.059879 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:50.059858    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fk94m"]
Jul 16 12:00:50.064841 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:50.064823    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fk94m"]
Jul 16 12:00:51.343172 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.343133    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:51.399364 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.399335    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4a56367-a9a2-4f75-924f-68e0d3af3767" path="/var/lib/kubelet/pods/b4a56367-a9a2-4f75-924f-68e0d3af3767/volumes"
Jul 16 12:00:51.440492 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.440446    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:51.831447 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.831416    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"]
Jul 16 12:00:51.832143 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.832124    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4a56367-a9a2-4f75-924f-68e0d3af3767" containerName="limitador"
Jul 16 12:00:51.832143 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.832144    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4a56367-a9a2-4f75-924f-68e0d3af3767" containerName="limitador"
Jul 16 12:00:51.832257 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.832211    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4a56367-a9a2-4f75-924f-68e0d3af3767" containerName="limitador"
Jul 16 12:00:51.836620 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.836602    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"
Jul 16 12:00:51.839476 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.839437    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 16 12:00:51.839596 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.839574    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 12:00:51.840233 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.840217    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-98tnj\""
Jul 16 12:00:51.840300 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.840224    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 12:00:51.843892 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.843585    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"]
Jul 16 12:00:51.874853 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.874822    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:51.910623 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.910595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0fcaf4a6-433c-424c-ba6a-cc6dd6e06123-data\") pod \"postgres-69fb4594cf-dv5rs\" (UID: \"0fcaf4a6-433c-424c-ba6a-cc6dd6e06123\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"
Jul 16 12:00:51.910741 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:51.910646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdpff\" (UniqueName: \"kubernetes.io/projected/0fcaf4a6-433c-424c-ba6a-cc6dd6e06123-kube-api-access-cdpff\") pod \"postgres-69fb4594cf-dv5rs\" (UID: \"0fcaf4a6-433c-424c-ba6a-cc6dd6e06123\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"
Jul 16 12:00:52.011796 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:52.011753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdpff\" (UniqueName: \"kubernetes.io/projected/0fcaf4a6-433c-424c-ba6a-cc6dd6e06123-kube-api-access-cdpff\") pod \"postgres-69fb4594cf-dv5rs\" (UID: \"0fcaf4a6-433c-424c-ba6a-cc6dd6e06123\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"
Jul 16 12:00:52.011985 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:52.011867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0fcaf4a6-433c-424c-ba6a-cc6dd6e06123-data\") pod \"postgres-69fb4594cf-dv5rs\" (UID: \"0fcaf4a6-433c-424c-ba6a-cc6dd6e06123\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"
Jul 16 12:00:52.012180 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:52.012164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0fcaf4a6-433c-424c-ba6a-cc6dd6e06123-data\") pod \"postgres-69fb4594cf-dv5rs\" (UID: \"0fcaf4a6-433c-424c-ba6a-cc6dd6e06123\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"
Jul 16 12:00:52.025658 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:52.025635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdpff\" (UniqueName: \"kubernetes.io/projected/0fcaf4a6-433c-424c-ba6a-cc6dd6e06123-kube-api-access-cdpff\") pod \"postgres-69fb4594cf-dv5rs\" (UID: \"0fcaf4a6-433c-424c-ba6a-cc6dd6e06123\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"
Jul 16 12:00:52.147476 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:52.147427    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"
Jul 16 12:00:52.276637 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:52.276613    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"]
Jul 16 12:00:52.278448 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:00:52.278417    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fcaf4a6_433c_424c_ba6a_cc6dd6e06123.slice/crio-03c4ceb7df9b13e0741fc7fa274060ed474fb621effe9898c00eed71a6b9b498 WatchSource:0}: Error finding container 03c4ceb7df9b13e0741fc7fa274060ed474fb621effe9898c00eed71a6b9b498: Status 404 returned error can't find the container with id 03c4ceb7df9b13e0741fc7fa274060ed474fb621effe9898c00eed71a6b9b498
Jul 16 12:00:53.056202 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:53.056163    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs" event={"ID":"0fcaf4a6-433c-424c-ba6a-cc6dd6e06123","Type":"ContainerStarted","Data":"03c4ceb7df9b13e0741fc7fa274060ed474fb621effe9898c00eed71a6b9b498"}
Jul 16 12:00:53.984260 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:53.984223    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:00:58.083967 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:58.083921    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs" event={"ID":"0fcaf4a6-433c-424c-ba6a-cc6dd6e06123","Type":"ContainerStarted","Data":"21311c9df4a56f3f4397217d8adf8f8c0716d7383b0bb4c9782202eb21185d4e"}
Jul 16 12:00:58.084526 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:58.084026    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"
Jul 16 12:00:58.109418 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:00:58.109364    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs" podStartSLOduration=2.137014074 podStartE2EDuration="7.109348529s" totalImagesPullingTime="4.972334455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:00:58.106103253 +0000 UTC m=+623.220536529" watchObservedRunningTime="2026-07-16 12:00:58.109348529 +0000 UTC m=+623.223781805"
Jul 16 12:01:04.118142 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:04.118103    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv5rs"
Jul 16 12:01:04.485733 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:04.485691    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:04.693808 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:04.693770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:12.073582 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.073547    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:12.145107 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.145071    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f7cb4f5c4-zcdsj"]
Jul 16 12:01:12.174393 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.174364    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7cb4f5c4-zcdsj"]
Jul 16 12:01:12.174568 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.174471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:12.179551 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.179515    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 12:01:12.179551 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.179532    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 12:01:12.179822 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.179807    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gghsg\""
Jul 16 12:01:12.204325 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.204291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e4c036-fcee-4483-8a61-7c97a908ac69-webhook-cert\") pod \"maas-controller-f7cb4f5c4-zcdsj\" (UID: \"99e4c036-fcee-4483-8a61-7c97a908ac69\") " pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:12.204500 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.204357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzqg6\" (UniqueName: \"kubernetes.io/projected/99e4c036-fcee-4483-8a61-7c97a908ac69-kube-api-access-wzqg6\") pod \"maas-controller-f7cb4f5c4-zcdsj\" (UID: \"99e4c036-fcee-4483-8a61-7c97a908ac69\") " pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:12.304847 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.304814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e4c036-fcee-4483-8a61-7c97a908ac69-webhook-cert\") pod \"maas-controller-f7cb4f5c4-zcdsj\" (UID: \"99e4c036-fcee-4483-8a61-7c97a908ac69\") " pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:12.305050 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.304864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzqg6\" (UniqueName: \"kubernetes.io/projected/99e4c036-fcee-4483-8a61-7c97a908ac69-kube-api-access-wzqg6\") pod \"maas-controller-f7cb4f5c4-zcdsj\" (UID: \"99e4c036-fcee-4483-8a61-7c97a908ac69\") " pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:12.305050 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:01:12.304993    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 16 12:01:12.305196 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:01:12.305087    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99e4c036-fcee-4483-8a61-7c97a908ac69-webhook-cert podName:99e4c036-fcee-4483-8a61-7c97a908ac69 nodeName:}" failed. No retries permitted until 2026-07-16 12:01:12.805063522 +0000 UTC m=+637.919496784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/99e4c036-fcee-4483-8a61-7c97a908ac69-webhook-cert") pod "maas-controller-f7cb4f5c4-zcdsj" (UID: "99e4c036-fcee-4483-8a61-7c97a908ac69") : secret "maas-controller-webhook-cert" not found
Jul 16 12:01:12.322666 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.322642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzqg6\" (UniqueName: \"kubernetes.io/projected/99e4c036-fcee-4483-8a61-7c97a908ac69-kube-api-access-wzqg6\") pod \"maas-controller-f7cb4f5c4-zcdsj\" (UID: \"99e4c036-fcee-4483-8a61-7c97a908ac69\") " pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:12.376536 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.376423    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cc89574fb-5rsdj"]
Jul 16 12:01:12.380016 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.379999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:01:12.405867 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.405836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88k7v\" (UniqueName: \"kubernetes.io/projected/921c7d66-96c2-4e4c-bcda-efddbc390935-kube-api-access-88k7v\") pod \"maas-controller-cc89574fb-5rsdj\" (UID: \"921c7d66-96c2-4e4c-bcda-efddbc390935\") " pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:01:12.405988 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.405884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/921c7d66-96c2-4e4c-bcda-efddbc390935-webhook-cert\") pod \"maas-controller-cc89574fb-5rsdj\" (UID: \"921c7d66-96c2-4e4c-bcda-efddbc390935\") " pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:01:12.406215 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.406195    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cc89574fb-5rsdj"]
Jul 16 12:01:12.506386 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.506348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88k7v\" (UniqueName: \"kubernetes.io/projected/921c7d66-96c2-4e4c-bcda-efddbc390935-kube-api-access-88k7v\") pod \"maas-controller-cc89574fb-5rsdj\" (UID: \"921c7d66-96c2-4e4c-bcda-efddbc390935\") " pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:01:12.506386 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.506393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/921c7d66-96c2-4e4c-bcda-efddbc390935-webhook-cert\") pod \"maas-controller-cc89574fb-5rsdj\" (UID: \"921c7d66-96c2-4e4c-bcda-efddbc390935\") " pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:01:12.506619 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:01:12.506569    2580 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 16 12:01:12.506656 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:01:12.506629    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/921c7d66-96c2-4e4c-bcda-efddbc390935-webhook-cert podName:921c7d66-96c2-4e4c-bcda-efddbc390935 nodeName:}" failed. No retries permitted until 2026-07-16 12:01:13.00661464 +0000 UTC m=+638.121047894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/921c7d66-96c2-4e4c-bcda-efddbc390935-webhook-cert") pod "maas-controller-cc89574fb-5rsdj" (UID: "921c7d66-96c2-4e4c-bcda-efddbc390935") : secret "maas-controller-webhook-cert" not found
Jul 16 12:01:12.517157 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.517124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88k7v\" (UniqueName: \"kubernetes.io/projected/921c7d66-96c2-4e4c-bcda-efddbc390935-kube-api-access-88k7v\") pod \"maas-controller-cc89574fb-5rsdj\" (UID: \"921c7d66-96c2-4e4c-bcda-efddbc390935\") " pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:01:12.809549 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.809506    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e4c036-fcee-4483-8a61-7c97a908ac69-webhook-cert\") pod \"maas-controller-f7cb4f5c4-zcdsj\" (UID: \"99e4c036-fcee-4483-8a61-7c97a908ac69\") " pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:12.812071 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:12.812051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e4c036-fcee-4483-8a61-7c97a908ac69-webhook-cert\") pod \"maas-controller-f7cb4f5c4-zcdsj\" (UID: \"99e4c036-fcee-4483-8a61-7c97a908ac69\") " pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:13.011485 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:13.011426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/921c7d66-96c2-4e4c-bcda-efddbc390935-webhook-cert\") pod \"maas-controller-cc89574fb-5rsdj\" (UID: \"921c7d66-96c2-4e4c-bcda-efddbc390935\") " pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:01:13.013970 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:13.013939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/921c7d66-96c2-4e4c-bcda-efddbc390935-webhook-cert\") pod \"maas-controller-cc89574fb-5rsdj\" (UID: \"921c7d66-96c2-4e4c-bcda-efddbc390935\") " pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:01:13.085601 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:13.085512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:13.222856 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:13.222827    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7cb4f5c4-zcdsj"]
Jul 16 12:01:13.226170 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:01:13.226144    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e4c036_fcee_4483_8a61_7c97a908ac69.slice/crio-e5607857c16ec8c73a827fa65541b65ee509e69e0b0adaf99597b9c0551eeecc WatchSource:0}: Error finding container e5607857c16ec8c73a827fa65541b65ee509e69e0b0adaf99597b9c0551eeecc: Status 404 returned error can't find the container with id e5607857c16ec8c73a827fa65541b65ee509e69e0b0adaf99597b9c0551eeecc
Jul 16 12:01:13.290173 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:13.290137    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:01:13.363549 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:13.363510    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:13.433847 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:13.433823    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cc89574fb-5rsdj"]
Jul 16 12:01:13.436199 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:01:13.436170    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921c7d66_96c2_4e4c_bcda_efddbc390935.slice/crio-02d8fae03735ad8261ae09652091623621cbb7b9e7654f8d509dcd787982675a WatchSource:0}: Error finding container 02d8fae03735ad8261ae09652091623621cbb7b9e7654f8d509dcd787982675a: Status 404 returned error can't find the container with id 02d8fae03735ad8261ae09652091623621cbb7b9e7654f8d509dcd787982675a
Jul 16 12:01:13.509856 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:13.509816    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:14.162360 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:14.162283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc89574fb-5rsdj" event={"ID":"921c7d66-96c2-4e4c-bcda-efddbc390935","Type":"ContainerStarted","Data":"02d8fae03735ad8261ae09652091623621cbb7b9e7654f8d509dcd787982675a"}
Jul 16 12:01:14.163743 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:14.163697    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj" event={"ID":"99e4c036-fcee-4483-8a61-7c97a908ac69","Type":"ContainerStarted","Data":"e5607857c16ec8c73a827fa65541b65ee509e69e0b0adaf99597b9c0551eeecc"}
Jul 16 12:01:16.986172 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:16.986137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:17.182144 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:17.182105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc89574fb-5rsdj" event={"ID":"921c7d66-96c2-4e4c-bcda-efddbc390935","Type":"ContainerStarted","Data":"10980efb272847863009979d657190bcca41d595da47920108037abfd50fee75"}
Jul 16 12:01:17.182361 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:17.182234    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:01:17.184136 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:17.184110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj" event={"ID":"99e4c036-fcee-4483-8a61-7c97a908ac69","Type":"ContainerStarted","Data":"4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3"}
Jul 16 12:01:17.184263 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:17.184250    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:17.239535 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:17.239481    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cc89574fb-5rsdj" podStartSLOduration=1.907791589 podStartE2EDuration="5.239443767s" totalImagesPullingTime="3.331652178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:01:17.237115969 +0000 UTC m=+642.351549246" watchObservedRunningTime="2026-07-16 12:01:17.239443767 +0000 UTC m=+642.353877104"
Jul 16 12:01:17.327818 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:17.327753    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj" podStartSLOduration=1.7761677439999999 podStartE2EDuration="5.327734485s" totalImagesPullingTime="3.551566741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:01:17.325164196 +0000 UTC m=+642.439597471" watchObservedRunningTime="2026-07-16 12:01:17.327734485 +0000 UTC m=+642.442167789"
Jul 16 12:01:24.080500 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:24.080448    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:28.190883 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:28.190848    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:01:28.191324 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:28.191016    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:28.282269 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:28.282239    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f7cb4f5c4-zcdsj"]
Jul 16 12:01:28.282502 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:28.282438    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj" podUID="99e4c036-fcee-4483-8a61-7c97a908ac69" containerName="manager" containerID="cri-o://4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3" gracePeriod=30
Jul 16 12:01:28.521628 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:28.521598    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:28.666639 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:28.666610    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e4c036-fcee-4483-8a61-7c97a908ac69-webhook-cert\") pod \"99e4c036-fcee-4483-8a61-7c97a908ac69\" (UID: \"99e4c036-fcee-4483-8a61-7c97a908ac69\") "
Jul 16 12:01:28.666826 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:28.666754    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzqg6\" (UniqueName: \"kubernetes.io/projected/99e4c036-fcee-4483-8a61-7c97a908ac69-kube-api-access-wzqg6\") pod \"99e4c036-fcee-4483-8a61-7c97a908ac69\" (UID: \"99e4c036-fcee-4483-8a61-7c97a908ac69\") "
Jul 16 12:01:28.668761 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:28.668730    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e4c036-fcee-4483-8a61-7c97a908ac69-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "99e4c036-fcee-4483-8a61-7c97a908ac69" (UID: "99e4c036-fcee-4483-8a61-7c97a908ac69"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:01:28.668870 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:28.668811    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99e4c036-fcee-4483-8a61-7c97a908ac69-kube-api-access-wzqg6" (OuterVolumeSpecName: "kube-api-access-wzqg6") pod "99e4c036-fcee-4483-8a61-7c97a908ac69" (UID: "99e4c036-fcee-4483-8a61-7c97a908ac69"). InnerVolumeSpecName "kube-api-access-wzqg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:01:28.767590 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:28.767511    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzqg6\" (UniqueName: \"kubernetes.io/projected/99e4c036-fcee-4483-8a61-7c97a908ac69-kube-api-access-wzqg6\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:01:28.767590 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:28.767540    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99e4c036-fcee-4483-8a61-7c97a908ac69-webhook-cert\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:01:29.239112 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:29.239076    2580 generic.go:356] "Generic (PLEG): container finished" podID="99e4c036-fcee-4483-8a61-7c97a908ac69" containerID="4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3" exitCode=0
Jul 16 12:01:29.239554 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:29.239117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj" event={"ID":"99e4c036-fcee-4483-8a61-7c97a908ac69","Type":"ContainerDied","Data":"4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3"}
Jul 16 12:01:29.239554 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:29.239197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj" event={"ID":"99e4c036-fcee-4483-8a61-7c97a908ac69","Type":"ContainerDied","Data":"e5607857c16ec8c73a827fa65541b65ee509e69e0b0adaf99597b9c0551eeecc"}
Jul 16 12:01:29.239554 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:29.239127    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7cb4f5c4-zcdsj"
Jul 16 12:01:29.239554 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:29.239219    2580 scope.go:117] "RemoveContainer" containerID="4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3"
Jul 16 12:01:29.248527 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:29.248513    2580 scope.go:117] "RemoveContainer" containerID="4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3"
Jul 16 12:01:29.248731 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:01:29.248709    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3\": container with ID starting with 4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3 not found: ID does not exist" containerID="4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3"
Jul 16 12:01:29.248783 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:29.248739    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3"} err="failed to get container status \"4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3\": rpc error: code = NotFound desc = could not find container \"4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3\": container with ID starting with 4e0806e3565ecff28d9ee834bf44ef6f5eb36222521640544801590e3725add3 not found: ID does not exist"
Jul 16 12:01:29.263076 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:29.263053    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f7cb4f5c4-zcdsj"]
Jul 16 12:01:29.270034 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:29.270015    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f7cb4f5c4-zcdsj"]
Jul 16 12:01:29.398850 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:29.398824    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99e4c036-fcee-4483-8a61-7c97a908ac69" path="/var/lib/kubelet/pods/99e4c036-fcee-4483-8a61-7c97a908ac69/volumes"
Jul 16 12:01:38.048751 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:38.048705    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:49.142631 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.142597    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:49.288581 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.288523    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:49.810730 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.810694    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:49.906354 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.906311    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"]
Jul 16 12:01:49.906770 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.906753    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99e4c036-fcee-4483-8a61-7c97a908ac69" containerName="manager"
Jul 16 12:01:49.906862 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.906773    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="99e4c036-fcee-4483-8a61-7c97a908ac69" containerName="manager"
Jul 16 12:01:49.906917 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.906885    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="99e4c036-fcee-4483-8a61-7c97a908ac69" containerName="manager"
Jul 16 12:01:49.912597 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.912576    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:49.915177 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.915157    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 16 12:01:49.915271 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.915160    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n4wqr\""
Jul 16 12:01:49.923885 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.923860    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"]
Jul 16 12:01:49.952929 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.952894    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02357f57-f61b-4823-9192-8d2e3aef4a14-openshift-service-ca\") pod \"maas-api-767ccf7cdf-m7w88\" (UID: \"02357f57-f61b-4823-9192-8d2e3aef4a14\") " pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:49.953102 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.952977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02357f57-f61b-4823-9192-8d2e3aef4a14-maas-api-tls\") pod \"maas-api-767ccf7cdf-m7w88\" (UID: \"02357f57-f61b-4823-9192-8d2e3aef4a14\") " pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:49.953102 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:49.953003    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzkng\" (UniqueName: \"kubernetes.io/projected/02357f57-f61b-4823-9192-8d2e3aef4a14-kube-api-access-qzkng\") pod \"maas-api-767ccf7cdf-m7w88\" (UID: \"02357f57-f61b-4823-9192-8d2e3aef4a14\") " pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:50.053867 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.053831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02357f57-f61b-4823-9192-8d2e3aef4a14-openshift-service-ca\") pod \"maas-api-767ccf7cdf-m7w88\" (UID: \"02357f57-f61b-4823-9192-8d2e3aef4a14\") " pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:50.054044 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.053904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02357f57-f61b-4823-9192-8d2e3aef4a14-maas-api-tls\") pod \"maas-api-767ccf7cdf-m7w88\" (UID: \"02357f57-f61b-4823-9192-8d2e3aef4a14\") " pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:50.054044 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.053928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzkng\" (UniqueName: \"kubernetes.io/projected/02357f57-f61b-4823-9192-8d2e3aef4a14-kube-api-access-qzkng\") pod \"maas-api-767ccf7cdf-m7w88\" (UID: \"02357f57-f61b-4823-9192-8d2e3aef4a14\") " pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:50.054577 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.054552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02357f57-f61b-4823-9192-8d2e3aef4a14-openshift-service-ca\") pod \"maas-api-767ccf7cdf-m7w88\" (UID: \"02357f57-f61b-4823-9192-8d2e3aef4a14\") " pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:50.056489 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.056449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02357f57-f61b-4823-9192-8d2e3aef4a14-maas-api-tls\") pod \"maas-api-767ccf7cdf-m7w88\" (UID: \"02357f57-f61b-4823-9192-8d2e3aef4a14\") " pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:50.063723 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.063658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzkng\" (UniqueName: \"kubernetes.io/projected/02357f57-f61b-4823-9192-8d2e3aef4a14-kube-api-access-qzkng\") pod \"maas-api-767ccf7cdf-m7w88\" (UID: \"02357f57-f61b-4823-9192-8d2e3aef4a14\") " pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:50.223750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.223718    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:50.370443 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.370338    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"]
Jul 16 12:01:50.374170 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:01:50.374136    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02357f57_f61b_4823_9192_8d2e3aef4a14.slice/crio-3af3f39b536d56d36f5efff72d09411011ab52f5e32a38d0c62fcf76e549741f WatchSource:0}: Error finding container 3af3f39b536d56d36f5efff72d09411011ab52f5e32a38d0c62fcf76e549741f: Status 404 returned error can't find the container with id 3af3f39b536d56d36f5efff72d09411011ab52f5e32a38d0c62fcf76e549741f
Jul 16 12:01:50.535649 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.535611    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"]
Jul 16 12:01:50.539866 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.539850    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"
Jul 16 12:01:50.542845 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.542823    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 12:01:50.542984 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.542862    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-prpnc\""
Jul 16 12:01:50.557574 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.557448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bcb3f0c-3275-4e94-a91e-d7df7baeafea-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-wvd6s\" (UID: \"5bcb3f0c-3275-4e94-a91e-d7df7baeafea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"
Jul 16 12:01:50.557731 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.557582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxb22\" (UniqueName: \"kubernetes.io/projected/5bcb3f0c-3275-4e94-a91e-d7df7baeafea-kube-api-access-vxb22\") pod \"payload-processing-f9b8d9b9b-wvd6s\" (UID: \"5bcb3f0c-3275-4e94-a91e-d7df7baeafea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"
Jul 16 12:01:50.559406 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.559332    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"]
Jul 16 12:01:50.604770 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.604734    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"]
Jul 16 12:01:50.607937 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.607919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"
Jul 16 12:01:50.627755 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.627693    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"]
Jul 16 12:01:50.658160 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.658131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bcb3f0c-3275-4e94-a91e-d7df7baeafea-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-wvd6s\" (UID: \"5bcb3f0c-3275-4e94-a91e-d7df7baeafea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"
Jul 16 12:01:50.658337 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.658181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxb22\" (UniqueName: \"kubernetes.io/projected/5bcb3f0c-3275-4e94-a91e-d7df7baeafea-kube-api-access-vxb22\") pod \"payload-processing-f9b8d9b9b-wvd6s\" (UID: \"5bcb3f0c-3275-4e94-a91e-d7df7baeafea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"
Jul 16 12:01:50.658337 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.658221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a235c96a-fe33-4f36-8919-7350d1adab6c-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-7lrcd\" (UID: \"a235c96a-fe33-4f36-8919-7350d1adab6c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"
Jul 16 12:01:50.658337 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.658262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvfg4\" (UniqueName: \"kubernetes.io/projected/a235c96a-fe33-4f36-8919-7350d1adab6c-kube-api-access-dvfg4\") pod \"payload-pre-processing-74584bb9f8-7lrcd\" (UID: \"a235c96a-fe33-4f36-8919-7350d1adab6c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"
Jul 16 12:01:50.658838 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.658820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bcb3f0c-3275-4e94-a91e-d7df7baeafea-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-wvd6s\" (UID: \"5bcb3f0c-3275-4e94-a91e-d7df7baeafea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"
Jul 16 12:01:50.668573 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.668547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxb22\" (UniqueName: \"kubernetes.io/projected/5bcb3f0c-3275-4e94-a91e-d7df7baeafea-kube-api-access-vxb22\") pod \"payload-processing-f9b8d9b9b-wvd6s\" (UID: \"5bcb3f0c-3275-4e94-a91e-d7df7baeafea\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"
Jul 16 12:01:50.759383 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.759339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a235c96a-fe33-4f36-8919-7350d1adab6c-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-7lrcd\" (UID: \"a235c96a-fe33-4f36-8919-7350d1adab6c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"
Jul 16 12:01:50.759623 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.759417    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvfg4\" (UniqueName: \"kubernetes.io/projected/a235c96a-fe33-4f36-8919-7350d1adab6c-kube-api-access-dvfg4\") pod \"payload-pre-processing-74584bb9f8-7lrcd\" (UID: \"a235c96a-fe33-4f36-8919-7350d1adab6c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"
Jul 16 12:01:50.760273 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.760249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a235c96a-fe33-4f36-8919-7350d1adab6c-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-7lrcd\" (UID: \"a235c96a-fe33-4f36-8919-7350d1adab6c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"
Jul 16 12:01:50.780424 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.780384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvfg4\" (UniqueName: \"kubernetes.io/projected/a235c96a-fe33-4f36-8919-7350d1adab6c-kube-api-access-dvfg4\") pod \"payload-pre-processing-74584bb9f8-7lrcd\" (UID: \"a235c96a-fe33-4f36-8919-7350d1adab6c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"
Jul 16 12:01:50.851301 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.851269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"
Jul 16 12:01:50.917430 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.917402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"
Jul 16 12:01:50.999283 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:50.999259    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"]
Jul 16 12:01:51.001332 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:01:51.001297    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bcb3f0c_3275_4e94_a91e_d7df7baeafea.slice/crio-056972f58ef78c99c529777b6f582085db14dc03a828bf3790c0c51af1baec83 WatchSource:0}: Error finding container 056972f58ef78c99c529777b6f582085db14dc03a828bf3790c0c51af1baec83: Status 404 returned error can't find the container with id 056972f58ef78c99c529777b6f582085db14dc03a828bf3790c0c51af1baec83
Jul 16 12:01:51.074989 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:51.074961    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"]
Jul 16 12:01:51.077627 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:01:51.077597    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda235c96a_fe33_4f36_8919_7350d1adab6c.slice/crio-af813037eb42a1077fdd1c1d7149a1d0b1285673b0cc57ddff6045f4743d10a1 WatchSource:0}: Error finding container af813037eb42a1077fdd1c1d7149a1d0b1285673b0cc57ddff6045f4743d10a1: Status 404 returned error can't find the container with id af813037eb42a1077fdd1c1d7149a1d0b1285673b0cc57ddff6045f4743d10a1
Jul 16 12:01:51.203533 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:51.203417    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:51.304162 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:51.304123    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:01:51.345668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:51.345623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s" event={"ID":"5bcb3f0c-3275-4e94-a91e-d7df7baeafea","Type":"ContainerStarted","Data":"056972f58ef78c99c529777b6f582085db14dc03a828bf3790c0c51af1baec83"}
Jul 16 12:01:51.346912 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:51.346887    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd" event={"ID":"a235c96a-fe33-4f36-8919-7350d1adab6c","Type":"ContainerStarted","Data":"af813037eb42a1077fdd1c1d7149a1d0b1285673b0cc57ddff6045f4743d10a1"}
Jul 16 12:01:51.348103 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:51.348077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88" event={"ID":"02357f57-f61b-4823-9192-8d2e3aef4a14","Type":"ContainerStarted","Data":"3af3f39b536d56d36f5efff72d09411011ab52f5e32a38d0c62fcf76e549741f"}
Jul 16 12:01:53.359569 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:53.359531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88" event={"ID":"02357f57-f61b-4823-9192-8d2e3aef4a14","Type":"ContainerStarted","Data":"82c2c90621415691bba11135bf35440cb98d7c571debed1d5241692d2c0ac4f0"}
Jul 16 12:01:53.360031 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:53.359789    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:01:53.361410 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:53.361388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s" event={"ID":"5bcb3f0c-3275-4e94-a91e-d7df7baeafea","Type":"ContainerStarted","Data":"406d804269cd3001574cf6a2ff6167916bd88c20dfd9ae77007c8a872cd380e0"}
Jul 16 12:01:53.361553 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:53.361495    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"
Jul 16 12:01:53.392644 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:53.392582    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88" podStartSLOduration=2.095240843 podStartE2EDuration="4.392561161s" totalImagesPullingTime="2.297320318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:01:53.38995646 +0000 UTC m=+678.504389737" watchObservedRunningTime="2026-07-16 12:01:53.392561161 +0000 UTC m=+678.506994438"
Jul 16 12:01:53.417436 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:53.417387    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s" podStartSLOduration=1.745426068 podStartE2EDuration="3.41737128s" totalImagesPullingTime="1.671945212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:01:53.415588441 +0000 UTC m=+678.530021718" watchObservedRunningTime="2026-07-16 12:01:53.41737128 +0000 UTC m=+678.531804555"
Jul 16 12:01:55.372368 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:55.372337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd" event={"ID":"a235c96a-fe33-4f36-8919-7350d1adab6c","Type":"ContainerStarted","Data":"23ddc193cf9fb12da2096d407de14ede566b18720dd16cd40335e25ab2cfc367"}
Jul 16 12:01:55.372801 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:55.372491    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"
Jul 16 12:01:55.392644 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:55.392544    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd" podStartSLOduration=1.331555904 podStartE2EDuration="5.392528483s" totalImagesPullingTime="4.060972579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:01:55.390953859 +0000 UTC m=+680.505387136" watchObservedRunningTime="2026-07-16 12:01:55.392528483 +0000 UTC m=+680.506961759"
Jul 16 12:01:59.372156 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:01:59.372125    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-767ccf7cdf-m7w88"
Jul 16 12:02:00.448565 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:00.448522    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:02:00.597819 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:00.597784    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:02:04.368539 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:04.368509    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-wvd6s"
Jul 16 12:02:06.379270 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:06.379240    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-7lrcd"
Jul 16 12:02:24.900500 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.900447    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"]
Jul 16 12:02:24.904181 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.904160    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:24.906811 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.906786    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6577m\""
Jul 16 12:02:24.907728 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.907714    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 16 12:02:24.907795 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.907748    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 12:02:24.909886 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.909821    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 12:02:24.916174 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.916151    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"]
Jul 16 12:02:24.931524 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.931503    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:02:24.968266 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.968239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:24.968365 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.968282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d503ad83-9fa1-4d47-a5bb-f61c64884833-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:24.968365 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.968358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:24.968438 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.968395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:24.968509 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.968446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:24.968509 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:24.968488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44f6p\" (UniqueName: \"kubernetes.io/projected/d503ad83-9fa1-4d47-a5bb-f61c64884833-kube-api-access-44f6p\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.068911 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.068867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.069097 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.068922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.069097 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.068972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.069097 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.068997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44f6p\" (UniqueName: \"kubernetes.io/projected/d503ad83-9fa1-4d47-a5bb-f61c64884833-kube-api-access-44f6p\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.069097 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.069031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.069097 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.069070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d503ad83-9fa1-4d47-a5bb-f61c64884833-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.069367 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.069294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.069367 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.069355    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.069494 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.069411    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.071315 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.071291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d503ad83-9fa1-4d47-a5bb-f61c64884833-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.071603 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.071584    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d503ad83-9fa1-4d47-a5bb-f61c64884833-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.077997 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.077973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44f6p\" (UniqueName: \"kubernetes.io/projected/d503ad83-9fa1-4d47-a5bb-f61c64884833-kube-api-access-44f6p\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9\" (UID: \"d503ad83-9fa1-4d47-a5bb-f61c64884833\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.214490 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.214391    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:25.358111 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.358083    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"]
Jul 16 12:02:25.360766 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:02:25.360744    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd503ad83_9fa1_4d47_a5bb_f61c64884833.slice/crio-745a3718769538a3cc048ef9da2f87bdb216f93d0e87349cf7a81e371da9ef1c WatchSource:0}: Error finding container 745a3718769538a3cc048ef9da2f87bdb216f93d0e87349cf7a81e371da9ef1c: Status 404 returned error can't find the container with id 745a3718769538a3cc048ef9da2f87bdb216f93d0e87349cf7a81e371da9ef1c
Jul 16 12:02:25.362501 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.362482    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:02:25.514694 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:25.514594    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9" event={"ID":"d503ad83-9fa1-4d47-a5bb-f61c64884833","Type":"ContainerStarted","Data":"745a3718769538a3cc048ef9da2f87bdb216f93d0e87349cf7a81e371da9ef1c"}
Jul 16 12:02:26.521331 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:26.521302    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9" event={"ID":"d503ad83-9fa1-4d47-a5bb-f61c64884833","Type":"ContainerStarted","Data":"9c3598019a0a8e58cfeef7074c65cd34c05ff5ff5f64ae937471c0e1e017efd1"}
Jul 16 12:02:28.339120 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:28.339072    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:02:35.215174 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:35.215136    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:35.215658 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:35.215218    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:35.228130 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:35.228109    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:35.251396 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:35.251350    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9" podStartSLOduration=10.168549847 podStartE2EDuration="11.251332109s" totalImagesPullingTime="1.082782262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:02:26.555895948 +0000 UTC m=+711.670329224" watchObservedRunningTime="2026-07-16 12:02:35.251332109 +0000 UTC m=+720.365765385"
Jul 16 12:02:35.573177 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:35.573092    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9"
Jul 16 12:02:43.689772 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:43.689727    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:02:43.791414 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:43.791375    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:02:46.367041 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.367009    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"]
Jul 16 12:02:46.370787 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.370771    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.376686 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.376652    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 16 12:02:46.398911 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.398884    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"]
Jul 16 12:02:46.413422 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.413386    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:02:46.456231 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.456205    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.456348 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.456262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.456348 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.456281    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.456518 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.456394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdfnw\" (UniqueName: \"kubernetes.io/projected/e218da8d-da63-4165-b1e6-99e5b6fb24cf-kube-api-access-wdfnw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.456518 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.456440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e218da8d-da63-4165-b1e6-99e5b6fb24cf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.456622 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.456545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.557378 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.557340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdfnw\" (UniqueName: \"kubernetes.io/projected/e218da8d-da63-4165-b1e6-99e5b6fb24cf-kube-api-access-wdfnw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.557603 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.557407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e218da8d-da63-4165-b1e6-99e5b6fb24cf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.557603 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.557438    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.557603 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.557556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.557784 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.557607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.557784 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.557633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.558060 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.558033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.558244 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.558127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.558415 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.558393    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.560319 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.560275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e218da8d-da63-4165-b1e6-99e5b6fb24cf-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.560319 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.560296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e218da8d-da63-4165-b1e6-99e5b6fb24cf-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.567627 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.567599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdfnw\" (UniqueName: \"kubernetes.io/projected/e218da8d-da63-4165-b1e6-99e5b6fb24cf-kube-api-access-wdfnw\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p96sn\" (UID: \"e218da8d-da63-4165-b1e6-99e5b6fb24cf\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.681301 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.681269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:46.820186 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:46.820129    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"]
Jul 16 12:02:46.822651 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:02:46.822623    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode218da8d_da63_4165_b1e6_99e5b6fb24cf.slice/crio-109ab629edd5bdcfcfa3ad4e54b9fd249b2abc1d127c86cf3bc25a64e031108c WatchSource:0}: Error finding container 109ab629edd5bdcfcfa3ad4e54b9fd249b2abc1d127c86cf3bc25a64e031108c: Status 404 returned error can't find the container with id 109ab629edd5bdcfcfa3ad4e54b9fd249b2abc1d127c86cf3bc25a64e031108c
Jul 16 12:02:47.616573 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:47.616496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn" event={"ID":"e218da8d-da63-4165-b1e6-99e5b6fb24cf","Type":"ContainerStarted","Data":"aeaf576087fb08cbc195eef431dacd7db4af35c8adb4f406a391e7f03ff2abf7"}
Jul 16 12:02:47.616573 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:47.616551    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn" event={"ID":"e218da8d-da63-4165-b1e6-99e5b6fb24cf","Type":"ContainerStarted","Data":"109ab629edd5bdcfcfa3ad4e54b9fd249b2abc1d127c86cf3bc25a64e031108c"}
Jul 16 12:02:47.675876 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:47.675822    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn" podStartSLOduration=1.288272102 podStartE2EDuration="1.675805263s" totalImagesPullingTime="387.533161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:02:47.674624226 +0000 UTC m=+732.789057496" watchObservedRunningTime="2026-07-16 12:02:47.675805263 +0000 UTC m=+732.790238535"
Jul 16 12:02:56.682178 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:56.682143    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:56.682578 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:56.682210    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:56.694766 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:56.694743    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:02:57.673703 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:02:57.673675    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p96sn"
Jul 16 12:03:00.606279 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:03:00.606236    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:03:15.961315 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:03:15.961176    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:03:24.861792 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:03:24.861745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:03:30.151815 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:03:30.151770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:21.866577 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:21.866508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:21.959845 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:21.959815    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:22.890140 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:22.890096    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:23.051350 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:23.051310    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:23.175716 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:23.175620    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:23.567840 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:23.567745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:23.837721 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:23.837625    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:33.996888 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:33.996854    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:34.102103 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:34.102070    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:34.202673 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:34.202635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:56.072660 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:56.072610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:56.220851 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:56.220803    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:04:56.320189 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:04:56.320153    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:05:35.382837 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:35.382758    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:05:35.383978 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:35.383954    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:05:35.387260 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:35.387236    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:05:35.387809 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:35.387791    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:05:37.264366 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.264324    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cc89574fb-5rsdj"]
Jul 16 12:05:37.264867 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.264605    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-cc89574fb-5rsdj" podUID="921c7d66-96c2-4e4c-bcda-efddbc390935" containerName="manager" containerID="cri-o://10980efb272847863009979d657190bcca41d595da47920108037abfd50fee75" gracePeriod=30
Jul 16 12:05:37.350699 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.350660    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:05:37.428484 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.428432    2580 generic.go:356] "Generic (PLEG): container finished" podID="921c7d66-96c2-4e4c-bcda-efddbc390935" containerID="10980efb272847863009979d657190bcca41d595da47920108037abfd50fee75" exitCode=0
Jul 16 12:05:37.428484 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.428489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc89574fb-5rsdj" event={"ID":"921c7d66-96c2-4e4c-bcda-efddbc390935","Type":"ContainerDied","Data":"10980efb272847863009979d657190bcca41d595da47920108037abfd50fee75"}
Jul 16 12:05:37.520587 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.520526    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:05:37.650114 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.650083    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/921c7d66-96c2-4e4c-bcda-efddbc390935-webhook-cert\") pod \"921c7d66-96c2-4e4c-bcda-efddbc390935\" (UID: \"921c7d66-96c2-4e4c-bcda-efddbc390935\") "
Jul 16 12:05:37.650297 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.650186    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88k7v\" (UniqueName: \"kubernetes.io/projected/921c7d66-96c2-4e4c-bcda-efddbc390935-kube-api-access-88k7v\") pod \"921c7d66-96c2-4e4c-bcda-efddbc390935\" (UID: \"921c7d66-96c2-4e4c-bcda-efddbc390935\") "
Jul 16 12:05:37.652223 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.652196    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/921c7d66-96c2-4e4c-bcda-efddbc390935-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "921c7d66-96c2-4e4c-bcda-efddbc390935" (UID: "921c7d66-96c2-4e4c-bcda-efddbc390935"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:05:37.652357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.652338    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/921c7d66-96c2-4e4c-bcda-efddbc390935-kube-api-access-88k7v" (OuterVolumeSpecName: "kube-api-access-88k7v") pod "921c7d66-96c2-4e4c-bcda-efddbc390935" (UID: "921c7d66-96c2-4e4c-bcda-efddbc390935"). InnerVolumeSpecName "kube-api-access-88k7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:05:37.751146 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.751118    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88k7v\" (UniqueName: \"kubernetes.io/projected/921c7d66-96c2-4e4c-bcda-efddbc390935-kube-api-access-88k7v\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:05:37.751146 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:37.751145    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/921c7d66-96c2-4e4c-bcda-efddbc390935-webhook-cert\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:05:38.433968 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:38.433934    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc89574fb-5rsdj"
Jul 16 12:05:38.434393 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:38.433969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc89574fb-5rsdj" event={"ID":"921c7d66-96c2-4e4c-bcda-efddbc390935","Type":"ContainerDied","Data":"02d8fae03735ad8261ae09652091623621cbb7b9e7654f8d509dcd787982675a"}
Jul 16 12:05:38.434393 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:38.434026    2580 scope.go:117] "RemoveContainer" containerID="10980efb272847863009979d657190bcca41d595da47920108037abfd50fee75"
Jul 16 12:05:38.458144 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:38.458121    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cc89574fb-5rsdj"]
Jul 16 12:05:38.465975 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:38.465949    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cc89574fb-5rsdj"]
Jul 16 12:05:39.201320 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.201283    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:05:39.333767 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.333732    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cc89574fb-rbxqk"]
Jul 16 12:05:39.334169 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.334155    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="921c7d66-96c2-4e4c-bcda-efddbc390935" containerName="manager"
Jul 16 12:05:39.334220 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.334171    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="921c7d66-96c2-4e4c-bcda-efddbc390935" containerName="manager"
Jul 16 12:05:39.334264 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.334234    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="921c7d66-96c2-4e4c-bcda-efddbc390935" containerName="manager"
Jul 16 12:05:39.338544 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.338528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc89574fb-rbxqk"
Jul 16 12:05:39.343413 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.343390    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gghsg\""
Jul 16 12:05:39.343566 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.343444    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 12:05:39.344148 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.344130    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 12:05:39.354489 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.354451    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cc89574fb-rbxqk"]
Jul 16 12:05:39.399125 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.399097    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="921c7d66-96c2-4e4c-bcda-efddbc390935" path="/var/lib/kubelet/pods/921c7d66-96c2-4e4c-bcda-efddbc390935/volumes"
Jul 16 12:05:39.466154 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.466094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/044f18cd-56a7-4244-bc0e-0375b91001dc-webhook-cert\") pod \"maas-controller-cc89574fb-rbxqk\" (UID: \"044f18cd-56a7-4244-bc0e-0375b91001dc\") " pod="opendatahub/maas-controller-cc89574fb-rbxqk"
Jul 16 12:05:39.466154 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.466145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmwqw\" (UniqueName: \"kubernetes.io/projected/044f18cd-56a7-4244-bc0e-0375b91001dc-kube-api-access-jmwqw\") pod \"maas-controller-cc89574fb-rbxqk\" (UID: \"044f18cd-56a7-4244-bc0e-0375b91001dc\") " pod="opendatahub/maas-controller-cc89574fb-rbxqk"
Jul 16 12:05:39.567559 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.567536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/044f18cd-56a7-4244-bc0e-0375b91001dc-webhook-cert\") pod \"maas-controller-cc89574fb-rbxqk\" (UID: \"044f18cd-56a7-4244-bc0e-0375b91001dc\") " pod="opendatahub/maas-controller-cc89574fb-rbxqk"
Jul 16 12:05:39.567683 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.567582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmwqw\" (UniqueName: \"kubernetes.io/projected/044f18cd-56a7-4244-bc0e-0375b91001dc-kube-api-access-jmwqw\") pod \"maas-controller-cc89574fb-rbxqk\" (UID: \"044f18cd-56a7-4244-bc0e-0375b91001dc\") " pod="opendatahub/maas-controller-cc89574fb-rbxqk"
Jul 16 12:05:39.569951 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.569933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/044f18cd-56a7-4244-bc0e-0375b91001dc-webhook-cert\") pod \"maas-controller-cc89574fb-rbxqk\" (UID: \"044f18cd-56a7-4244-bc0e-0375b91001dc\") " pod="opendatahub/maas-controller-cc89574fb-rbxqk"
Jul 16 12:05:39.586046 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.586019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmwqw\" (UniqueName: \"kubernetes.io/projected/044f18cd-56a7-4244-bc0e-0375b91001dc-kube-api-access-jmwqw\") pod \"maas-controller-cc89574fb-rbxqk\" (UID: \"044f18cd-56a7-4244-bc0e-0375b91001dc\") " pod="opendatahub/maas-controller-cc89574fb-rbxqk"
Jul 16 12:05:39.648418 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.648394    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cc89574fb-rbxqk"
Jul 16 12:05:39.804542 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:39.804510    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cc89574fb-rbxqk"]
Jul 16 12:05:39.815928 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:05:39.815856    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044f18cd_56a7_4244_bc0e_0375b91001dc.slice/crio-6e2f80dc130a53c2f7171fa49696b1f3a823af597e7d2891c360c1e0b76c0bdd WatchSource:0}: Error finding container 6e2f80dc130a53c2f7171fa49696b1f3a823af597e7d2891c360c1e0b76c0bdd: Status 404 returned error can't find the container with id 6e2f80dc130a53c2f7171fa49696b1f3a823af597e7d2891c360c1e0b76c0bdd
Jul 16 12:05:40.444185 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:40.444143    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc89574fb-rbxqk" event={"ID":"044f18cd-56a7-4244-bc0e-0375b91001dc","Type":"ContainerStarted","Data":"6e2f80dc130a53c2f7171fa49696b1f3a823af597e7d2891c360c1e0b76c0bdd"}
Jul 16 12:05:41.449910 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:41.449873    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cc89574fb-rbxqk" event={"ID":"044f18cd-56a7-4244-bc0e-0375b91001dc","Type":"ContainerStarted","Data":"62cc4af0ff0f1a92cc60dc06ffbc05fe31337b9cb352303bfb7a2e21081dcf7e"}
Jul 16 12:05:41.450366 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:41.449994    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cc89574fb-rbxqk"
Jul 16 12:05:41.485290 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:41.485248    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cc89574fb-rbxqk" podStartSLOduration=1.634158546 podStartE2EDuration="2.485235025s" totalImagesPullingTime="851.076479ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:05:41.484568575 +0000 UTC m=+906.599001862" watchObservedRunningTime="2026-07-16 12:05:41.485235025 +0000 UTC m=+906.599668300"
Jul 16 12:05:52.457410 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:05:52.457367    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cc89574fb-rbxqk"
Jul 16 12:06:24.567414 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:06:24.567377    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:06:26.542234 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:06:26.542192    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:06:30.986029 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:06:30.985966    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:06:31.174025 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:06:31.173984    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:06:31.347618 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:06:31.347540    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:06:31.816130 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:06:31.816092    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:06:37.872145 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:06:37.872098    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:06:37.989358 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:06:37.989331    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:08:49.449244 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:08:49.449163    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:09:37.633388 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:09:37.633347    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:10:35.414890 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:10:35.414858    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:10:35.415428 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:10:35.414997    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:10:35.418181 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:10:35.418150    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:10:35.418334 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:10:35.418319    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:10:47.011980 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:10:47.011940    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:10:47.172367 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:10:47.172332    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:15:00.157954 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:00.157866    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736735-cg2b4"]
Jul 16 12:15:00.161909 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:00.161885    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736735-cg2b4"
Jul 16 12:15:00.164614 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:00.164597    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:15:00.171719 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:00.171703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736735-cg2b4"
Jul 16 12:15:00.183717 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:00.183649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736735-cg2b4"]
Jul 16 12:15:00.316929 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:00.316903    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736735-cg2b4"]
Jul 16 12:15:00.319399 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:15:00.319371    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3d4206_6472_4afe_9833_c21374102165.slice/crio-39ffe2516c74af1c65b43568490a1176c14a7e538eb0b8e7f4229ededbc41b8b WatchSource:0}: Error finding container 39ffe2516c74af1c65b43568490a1176c14a7e538eb0b8e7f4229ededbc41b8b: Status 404 returned error can't find the container with id 39ffe2516c74af1c65b43568490a1176c14a7e538eb0b8e7f4229ededbc41b8b
Jul 16 12:15:00.321378 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:00.321362    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:15:01.127650 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:01.127609    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736735-cg2b4" event={"ID":"ba3d4206-6472-4afe-9833-c21374102165","Type":"ContainerStarted","Data":"39ffe2516c74af1c65b43568490a1176c14a7e538eb0b8e7f4229ededbc41b8b"}
Jul 16 12:15:07.160990 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:07.160953    2580 generic.go:356] "Generic (PLEG): container finished" podID="ba3d4206-6472-4afe-9833-c21374102165" containerID="c4a96166ea8ca917df6fd450a1ff8763d39a8039c944687629238ee05572d4d9" exitCode=0
Jul 16 12:15:07.161365 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:07.161042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736735-cg2b4" event={"ID":"ba3d4206-6472-4afe-9833-c21374102165","Type":"ContainerDied","Data":"c4a96166ea8ca917df6fd450a1ff8763d39a8039c944687629238ee05572d4d9"}
Jul 16 12:15:08.299385 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:08.299359    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736735-cg2b4"
Jul 16 12:15:09.171242 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:09.171211    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736735-cg2b4"
Jul 16 12:15:09.171416 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:09.171249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736735-cg2b4" event={"ID":"ba3d4206-6472-4afe-9833-c21374102165","Type":"ContainerDied","Data":"39ffe2516c74af1c65b43568490a1176c14a7e538eb0b8e7f4229ededbc41b8b"}
Jul 16 12:15:09.171416 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:09.171295    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39ffe2516c74af1c65b43568490a1176c14a7e538eb0b8e7f4229ededbc41b8b"
Jul 16 12:15:35.445618 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:35.445584    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:15:35.446507 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:35.446482    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:15:35.449243 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:35.449222    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:15:35.450290 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:35.450274    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:15:47.022813 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:15:47.022779    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:16:22.433695 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:16:22.433655    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:17:08.529601 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:17:08.529563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:17:09.693223 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:17:09.693186    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:17:55.555636 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:17:55.555548    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:03.915182 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:03.915137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:12.226094 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:12.226061    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:17.492953 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:17.492920    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:20.883069 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:20.883033    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:21.047608 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:21.047560    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:21.463152 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:21.463119    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:28.166245 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:28.166205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:28.290385 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:28.290349    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:28.572719 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:28.572651    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:28.691899 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:28.691863    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:29.664145 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.664115    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:29.824070 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.824037    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:29.869096 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.869061    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"]
Jul 16 12:18:29.869548 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.869530    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba3d4206-6472-4afe-9833-c21374102165" containerName="cleanup"
Jul 16 12:18:29.869548 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.869550    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba3d4206-6472-4afe-9833-c21374102165" containerName="cleanup"
Jul 16 12:18:29.869723 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.869659    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba3d4206-6472-4afe-9833-c21374102165" containerName="cleanup"
Jul 16 12:18:29.872717 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.872696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:29.889065 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.889038    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-59180a3f-serving-cert\""
Jul 16 12:18:29.905886 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.905860    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"]
Jul 16 12:18:29.980718 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.980634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-maas-api-tls\") pod \"maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:29.980718 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.980671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwgk4\" (UniqueName: \"kubernetes.io/projected/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-kube-api-access-cwgk4\") pod \"maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:29.980936 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:29.980765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-openshift-service-ca\") pod \"maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:30.081570 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:30.081540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-maas-api-tls\") pod \"maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:30.081570 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:30.081572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwgk4\" (UniqueName: \"kubernetes.io/projected/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-kube-api-access-cwgk4\") pod \"maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:30.081852 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:30.081595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-openshift-service-ca\") pod \"maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:30.082251 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:30.082216    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-openshift-service-ca\") pod \"maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:30.084090 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:30.084062    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-maas-api-tls\") pod \"maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:30.105941 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:30.105912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwgk4\" (UniqueName: \"kubernetes.io/projected/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-kube-api-access-cwgk4\") pod \"maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:30.147000 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:30.146963    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:30.182740 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:30.182702    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:30.317657 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:30.317622    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:30.557585 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:30.557555    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"]
Jul 16 12:18:30.560339 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:18:30.560313    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f23a2b9_3677_45cb_82a6_8a74e9a0ae6f.slice/crio-9498fe25470c8b7c439d0678d7ba71ba1ea34797e9bf066f104dc69a4d492dfa WatchSource:0}: Error finding container 9498fe25470c8b7c439d0678d7ba71ba1ea34797e9bf066f104dc69a4d492dfa: Status 404 returned error can't find the container with id 9498fe25470c8b7c439d0678d7ba71ba1ea34797e9bf066f104dc69a4d492dfa
Jul 16 12:18:31.124103 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:31.124072    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:31.146934 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:31.146905    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z" event={"ID":"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f","Type":"ContainerStarted","Data":"9498fe25470c8b7c439d0678d7ba71ba1ea34797e9bf066f104dc69a4d492dfa"}
Jul 16 12:18:31.555033 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:31.554995    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:32.491184 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:32.491145    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:18:33.157836 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:33.157806    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z" event={"ID":"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f","Type":"ContainerStarted","Data":"2b986c2608a36c2cd3f139019bb103b3c847d7ed50b706f5e39017edf5dd7862"}
Jul 16 12:18:33.158020 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:33.157865    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:33.185918 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:33.185862    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z" podStartSLOduration=1.916247737 podStartE2EDuration="4.185844862s" totalImagesPullingTime="2.269597125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:18:33.18423595 +0000 UTC m=+1678.298669228" watchObservedRunningTime="2026-07-16 12:18:33.185844862 +0000 UTC m=+1678.300278137"
Jul 16 12:18:34.748314 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:34.748272    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"]
Jul 16 12:18:34.752053 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:34.752031    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"
Jul 16 12:18:34.754526 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:34.754508    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:18:34.760851 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:34.760827    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"]
Jul 16 12:18:34.927214 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:34.927181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e12263b4-0a29-4751-843a-e5cf72140e31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b\" (UID: \"e12263b4-0a29-4751-843a-e5cf72140e31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"
Jul 16 12:18:35.028239 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:35.028151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e12263b4-0a29-4751-843a-e5cf72140e31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b\" (UID: \"e12263b4-0a29-4751-843a-e5cf72140e31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"
Jul 16 12:18:35.028773 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:35.028753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e12263b4-0a29-4751-843a-e5cf72140e31-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b\" (UID: \"e12263b4-0a29-4751-843a-e5cf72140e31\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"
Jul 16 12:18:35.063946 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:35.063917    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"
Jul 16 12:18:35.201739 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:35.201712    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"]
Jul 16 12:18:35.203697 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:18:35.203667    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12263b4_0a29_4751_843a_e5cf72140e31.slice/crio-04c01eb4cf814c23d1d5b78cba06b15b05b3754f0aa6a5076bc1906611694c6c WatchSource:0}: Error finding container 04c01eb4cf814c23d1d5b78cba06b15b05b3754f0aa6a5076bc1906611694c6c: Status 404 returned error can't find the container with id 04c01eb4cf814c23d1d5b78cba06b15b05b3754f0aa6a5076bc1906611694c6c
Jul 16 12:18:36.174433 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:36.174398    2580 generic.go:356] "Generic (PLEG): container finished" podID="e12263b4-0a29-4751-843a-e5cf72140e31" containerID="493ec6fd8bc4a94e269babe0d0f57fc8ad97b91a546dfb7f81784da819301d60" exitCode=7
Jul 16 12:18:36.174847 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:36.174488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b" event={"ID":"e12263b4-0a29-4751-843a-e5cf72140e31","Type":"ContainerDied","Data":"493ec6fd8bc4a94e269babe0d0f57fc8ad97b91a546dfb7f81784da819301d60"}
Jul 16 12:18:36.174847 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:36.174548    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b" event={"ID":"e12263b4-0a29-4751-843a-e5cf72140e31","Type":"ContainerStarted","Data":"04c01eb4cf814c23d1d5b78cba06b15b05b3754f0aa6a5076bc1906611694c6c"}
Jul 16 12:18:36.174847 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:36.174644    2580 scope.go:117] "RemoveContainer" containerID="493ec6fd8bc4a94e269babe0d0f57fc8ad97b91a546dfb7f81784da819301d60"
Jul 16 12:18:37.181851 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:37.181803    2580 generic.go:356] "Generic (PLEG): container finished" podID="e12263b4-0a29-4751-843a-e5cf72140e31" containerID="b8f38d13ab484ec0bcb2f63d8896ed2b1924eec720068a6c7d587480bed11868" exitCode=7
Jul 16 12:18:37.182311 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:37.181870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b" event={"ID":"e12263b4-0a29-4751-843a-e5cf72140e31","Type":"ContainerDied","Data":"b8f38d13ab484ec0bcb2f63d8896ed2b1924eec720068a6c7d587480bed11868"}
Jul 16 12:18:37.182311 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:37.181929    2580 scope.go:117] "RemoveContainer" containerID="493ec6fd8bc4a94e269babe0d0f57fc8ad97b91a546dfb7f81784da819301d60"
Jul 16 12:18:37.182311 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:37.182129    2580 scope.go:117] "RemoveContainer" containerID="b8f38d13ab484ec0bcb2f63d8896ed2b1924eec720068a6c7d587480bed11868"
Jul 16 12:18:37.182515 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:18:37.182391    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b_odh-ai-gateway-infra(e12263b4-0a29-4751-843a-e5cf72140e31)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b" podUID="e12263b4-0a29-4751-843a-e5cf72140e31"
Jul 16 12:18:38.188906 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:38.188879    2580 scope.go:117] "RemoveContainer" containerID="b8f38d13ab484ec0bcb2f63d8896ed2b1924eec720068a6c7d587480bed11868"
Jul 16 12:18:38.189290 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:18:38.189053    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b_odh-ai-gateway-infra(e12263b4-0a29-4751-843a-e5cf72140e31)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b" podUID="e12263b4-0a29-4751-843a-e5cf72140e31"
Jul 16 12:18:39.168353 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:39.168322    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:18:52.394018 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:52.393986    2580 scope.go:117] "RemoveContainer" containerID="b8f38d13ab484ec0bcb2f63d8896ed2b1924eec720068a6c7d587480bed11868"
Jul 16 12:18:53.259236 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:53.259202    2580 generic.go:356] "Generic (PLEG): container finished" podID="e12263b4-0a29-4751-843a-e5cf72140e31" containerID="d18ab65789545605c276d5ac164e25817d6c762ec996ac658e28a68c9ecefcfc" exitCode=0
Jul 16 12:18:53.259433 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:53.259283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b" event={"ID":"e12263b4-0a29-4751-843a-e5cf72140e31","Type":"ContainerDied","Data":"d18ab65789545605c276d5ac164e25817d6c762ec996ac658e28a68c9ecefcfc"}
Jul 16 12:18:53.259433 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:53.259356    2580 scope.go:117] "RemoveContainer" containerID="b8f38d13ab484ec0bcb2f63d8896ed2b1924eec720068a6c7d587480bed11868"
Jul 16 12:18:54.294473 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:54.294420    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"]
Jul 16 12:18:54.405080 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:54.405056    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"
Jul 16 12:18:54.487783 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:54.487758    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e12263b4-0a29-4751-843a-e5cf72140e31-maas-api-service-ca\") pod \"e12263b4-0a29-4751-843a-e5cf72140e31\" (UID: \"e12263b4-0a29-4751-843a-e5cf72140e31\") "
Jul 16 12:18:54.488130 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:54.488104    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e12263b4-0a29-4751-843a-e5cf72140e31-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e12263b4-0a29-4751-843a-e5cf72140e31" (UID: "e12263b4-0a29-4751-843a-e5cf72140e31"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:18:54.589053 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:54.588985    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e12263b4-0a29-4751-843a-e5cf72140e31-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:18:55.271985 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:55.271956    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"
Jul 16 12:18:55.272155 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:55.271958    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b" event={"ID":"e12263b4-0a29-4751-843a-e5cf72140e31","Type":"ContainerDied","Data":"04c01eb4cf814c23d1d5b78cba06b15b05b3754f0aa6a5076bc1906611694c6c"}
Jul 16 12:18:55.272155 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:55.272081    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04c01eb4cf814c23d1d5b78cba06b15b05b3754f0aa6a5076bc1906611694c6c"
Jul 16 12:18:55.307745 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:55.305818    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"]
Jul 16 12:18:55.312111 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:55.312086    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-m4t8b"]
Jul 16 12:18:55.399432 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:18:55.399405    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e12263b4-0a29-4751-843a-e5cf72140e31" path="/var/lib/kubelet/pods/e12263b4-0a29-4751-843a-e5cf72140e31/volumes"
Jul 16 12:19:34.798398 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:34.798365    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2"]
Jul 16 12:19:34.798980 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:34.798964    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e12263b4-0a29-4751-843a-e5cf72140e31" containerName="revoke-keys"
Jul 16 12:19:34.799048 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:34.798981    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e12263b4-0a29-4751-843a-e5cf72140e31" containerName="revoke-keys"
Jul 16 12:19:34.799048 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:34.799002    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e12263b4-0a29-4751-843a-e5cf72140e31" containerName="revoke-keys"
Jul 16 12:19:34.799048 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:34.799011    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e12263b4-0a29-4751-843a-e5cf72140e31" containerName="revoke-keys"
Jul 16 12:19:34.799144 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:34.799071    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e12263b4-0a29-4751-843a-e5cf72140e31" containerName="revoke-keys"
Jul 16 12:19:34.799144 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:34.799083    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e12263b4-0a29-4751-843a-e5cf72140e31" containerName="revoke-keys"
Jul 16 12:19:34.802506 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:34.802490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2"
Jul 16 12:19:34.804881 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:34.804861    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:19:34.810490 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:34.810027    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2"]
Jul 16 12:19:34.952534 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:34.952496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed362784-5cbc-4a17-a5b0-7b90a56f8d2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2\" (UID: \"ed362784-5cbc-4a17-a5b0-7b90a56f8d2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2"
Jul 16 12:19:35.053509 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:35.053376    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed362784-5cbc-4a17-a5b0-7b90a56f8d2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2\" (UID: \"ed362784-5cbc-4a17-a5b0-7b90a56f8d2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2"
Jul 16 12:19:35.054024 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:35.054003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed362784-5cbc-4a17-a5b0-7b90a56f8d2c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2\" (UID: \"ed362784-5cbc-4a17-a5b0-7b90a56f8d2c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2"
Jul 16 12:19:35.114797 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:35.114763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2"
Jul 16 12:19:35.254071 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:35.254048    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2"]
Jul 16 12:19:35.256571 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:19:35.256536    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded362784_5cbc_4a17_a5b0_7b90a56f8d2c.slice/crio-26459176915e4edd2493fa2ef0a0cd90d967b79e014b564bb4f885ff76ed707a WatchSource:0}: Error finding container 26459176915e4edd2493fa2ef0a0cd90d967b79e014b564bb4f885ff76ed707a: Status 404 returned error can't find the container with id 26459176915e4edd2493fa2ef0a0cd90d967b79e014b564bb4f885ff76ed707a
Jul 16 12:19:35.463639 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:35.463605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2" event={"ID":"ed362784-5cbc-4a17-a5b0-7b90a56f8d2c","Type":"ContainerStarted","Data":"26459176915e4edd2493fa2ef0a0cd90d967b79e014b564bb4f885ff76ed707a"}
Jul 16 12:19:36.469418 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:36.469385    2580 generic.go:356] "Generic (PLEG): container finished" podID="ed362784-5cbc-4a17-a5b0-7b90a56f8d2c" containerID="5ab1a99e8b8298c17d8bb6ad7dfb3b5c5ba3185df4b98cbed2dbb6c914f2f275" exitCode=0
Jul 16 12:19:36.469790 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:36.469496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2" event={"ID":"ed362784-5cbc-4a17-a5b0-7b90a56f8d2c","Type":"ContainerDied","Data":"5ab1a99e8b8298c17d8bb6ad7dfb3b5c5ba3185df4b98cbed2dbb6c914f2f275"}
Jul 16 12:19:37.606644 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:37.606623    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2"
Jul 16 12:19:37.677540 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:37.677511    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed362784-5cbc-4a17-a5b0-7b90a56f8d2c-maas-api-service-ca\") pod \"ed362784-5cbc-4a17-a5b0-7b90a56f8d2c\" (UID: \"ed362784-5cbc-4a17-a5b0-7b90a56f8d2c\") "
Jul 16 12:19:37.677825 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:37.677806    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed362784-5cbc-4a17-a5b0-7b90a56f8d2c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ed362784-5cbc-4a17-a5b0-7b90a56f8d2c" (UID: "ed362784-5cbc-4a17-a5b0-7b90a56f8d2c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:19:37.778244 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:37.778144    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed362784-5cbc-4a17-a5b0-7b90a56f8d2c-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:19:38.479865 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:38.479833    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2"
Jul 16 12:19:38.480012 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:38.479869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2" event={"ID":"ed362784-5cbc-4a17-a5b0-7b90a56f8d2c","Type":"ContainerDied","Data":"26459176915e4edd2493fa2ef0a0cd90d967b79e014b564bb4f885ff76ed707a"}
Jul 16 12:19:38.480012 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:38.479916    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26459176915e4edd2493fa2ef0a0cd90d967b79e014b564bb4f885ff76ed707a"
Jul 16 12:19:45.282113 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.282080    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"]
Jul 16 12:19:45.282644 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.282302    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z" podUID="9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f" containerName="maas-api" containerID="cri-o://2b986c2608a36c2cd3f139019bb103b3c847d7ed50b706f5e39017edf5dd7862" gracePeriod=30
Jul 16 12:19:45.322953 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.322904    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:19:45.515573 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.515352    2580 generic.go:356] "Generic (PLEG): container finished" podID="9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f" containerID="2b986c2608a36c2cd3f139019bb103b3c847d7ed50b706f5e39017edf5dd7862" exitCode=0
Jul 16 12:19:45.515573 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.515424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z" event={"ID":"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f","Type":"ContainerDied","Data":"2b986c2608a36c2cd3f139019bb103b3c847d7ed50b706f5e39017edf5dd7862"}
Jul 16 12:19:45.533747 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.533696    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:19:45.650280 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.650250    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwgk4\" (UniqueName: \"kubernetes.io/projected/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-kube-api-access-cwgk4\") pod \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") "
Jul 16 12:19:45.650434 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.650299    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-maas-api-tls\") pod \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") "
Jul 16 12:19:45.650434 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.650402    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-openshift-service-ca\") pod \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\" (UID: \"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f\") "
Jul 16 12:19:45.650750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.650729    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f" (UID: "9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:19:45.652581 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.652555    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-kube-api-access-cwgk4" (OuterVolumeSpecName: "kube-api-access-cwgk4") pod "9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f" (UID: "9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f"). InnerVolumeSpecName "kube-api-access-cwgk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:19:45.652581 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.652576    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f" (UID: "9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:19:45.751853 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.751825    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:19:45.751853 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.751849    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwgk4\" (UniqueName: \"kubernetes.io/projected/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-kube-api-access-cwgk4\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:19:45.752007 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:45.751863    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:19:46.521881 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:46.521841    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z" event={"ID":"9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f","Type":"ContainerDied","Data":"9498fe25470c8b7c439d0678d7ba71ba1ea34797e9bf066f104dc69a4d492dfa"}
Jul 16 12:19:46.522330 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:46.521908    2580 scope.go:117] "RemoveContainer" containerID="2b986c2608a36c2cd3f139019bb103b3c847d7ed50b706f5e39017edf5dd7862"
Jul 16 12:19:46.522330 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:46.521853    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"
Jul 16 12:19:46.543203 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:46.543121    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"]
Jul 16 12:19:46.545324 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:46.545304    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-59180a3f-6d965cbb7f-ft29z"]
Jul 16 12:19:47.399226 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:47.399192    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f" path="/var/lib/kubelet/pods/9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f/volumes"
Jul 16 12:19:49.904779 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:49.904742    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:19:55.442514 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:55.442453    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:19:55.999481 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:55.999432    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:19:56.101437 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:19:56.101399    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:00.231063 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:00.231026    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:00.637411 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:00.637383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:00.789432 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:00.789383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:00.947589 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:00.947505    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:02.303909 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.303874    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"]
Jul 16 12:20:02.304482 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.304450    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed362784-5cbc-4a17-a5b0-7b90a56f8d2c" containerName="revoke-keys"
Jul 16 12:20:02.304538 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.304486    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed362784-5cbc-4a17-a5b0-7b90a56f8d2c" containerName="revoke-keys"
Jul 16 12:20:02.304538 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.304509    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f" containerName="maas-api"
Jul 16 12:20:02.304538 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.304517    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f" containerName="maas-api"
Jul 16 12:20:02.304638 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.304549    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e12263b4-0a29-4751-843a-e5cf72140e31" containerName="revoke-keys"
Jul 16 12:20:02.304638 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.304558    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e12263b4-0a29-4751-843a-e5cf72140e31" containerName="revoke-keys"
Jul 16 12:20:02.304698 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.304640    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e12263b4-0a29-4751-843a-e5cf72140e31" containerName="revoke-keys"
Jul 16 12:20:02.304698 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.304655    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f23a2b9-3677-45cb-82a6-8a74e9a0ae6f" containerName="maas-api"
Jul 16 12:20:02.304698 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.304665    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed362784-5cbc-4a17-a5b0-7b90a56f8d2c" containerName="revoke-keys"
Jul 16 12:20:02.309605 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.309580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:02.312389 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.312367    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-953cf885-serving-cert\""
Jul 16 12:20:02.318687 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.318663    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"]
Jul 16 12:20:02.385820 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.385771    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:02.408104 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.408072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f54cf\" (UniqueName: \"kubernetes.io/projected/651c523e-c2fc-4d03-8a1e-28579e770d5c-kube-api-access-f54cf\") pod \"maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:02.408302 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.408213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/651c523e-c2fc-4d03-8a1e-28579e770d5c-openshift-service-ca\") pod \"maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:02.408302 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.408274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/651c523e-c2fc-4d03-8a1e-28579e770d5c-maas-api-tls\") pod \"maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:02.508941 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.508902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f54cf\" (UniqueName: \"kubernetes.io/projected/651c523e-c2fc-4d03-8a1e-28579e770d5c-kube-api-access-f54cf\") pod \"maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:02.509139 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.509112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/651c523e-c2fc-4d03-8a1e-28579e770d5c-openshift-service-ca\") pod \"maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:02.509213 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.509169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/651c523e-c2fc-4d03-8a1e-28579e770d5c-maas-api-tls\") pod \"maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:02.509870 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.509845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/651c523e-c2fc-4d03-8a1e-28579e770d5c-openshift-service-ca\") pod \"maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:02.511772 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.511753    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/651c523e-c2fc-4d03-8a1e-28579e770d5c-maas-api-tls\") pod \"maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:02.519223 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.519200    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f54cf\" (UniqueName: \"kubernetes.io/projected/651c523e-c2fc-4d03-8a1e-28579e770d5c-kube-api-access-f54cf\") pod \"maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:02.541224 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.541195    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:02.622948 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.622851    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:02.784428 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.784394    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"]
Jul 16 12:20:02.787820 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:20:02.787771    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651c523e_c2fc_4d03_8a1e_28579e770d5c.slice/crio-7b1f7ae8965d66ab7c85f58758b3948e4e654a3cbfca882b6c00a03c3bdd4cfe WatchSource:0}: Error finding container 7b1f7ae8965d66ab7c85f58758b3948e4e654a3cbfca882b6c00a03c3bdd4cfe: Status 404 returned error can't find the container with id 7b1f7ae8965d66ab7c85f58758b3948e4e654a3cbfca882b6c00a03c3bdd4cfe
Jul 16 12:20:02.789086 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.789066    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:20:02.939008 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:02.938970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:03.109380 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:03.109347    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:03.556723 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:03.556649    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:03.602779 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:03.602749    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs" event={"ID":"651c523e-c2fc-4d03-8a1e-28579e770d5c","Type":"ContainerStarted","Data":"7b1f7ae8965d66ab7c85f58758b3948e4e654a3cbfca882b6c00a03c3bdd4cfe"}
Jul 16 12:20:04.609986 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:04.609954    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs" event={"ID":"651c523e-c2fc-4d03-8a1e-28579e770d5c","Type":"ContainerStarted","Data":"5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd"}
Jul 16 12:20:04.610483 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:04.610096    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:04.632424 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:04.632374    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs" podStartSLOduration=1.780511027 podStartE2EDuration="2.632356258s" totalImagesPullingTime="851.845231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:04.630147581 +0000 UTC m=+1769.744580857" watchObservedRunningTime="2026-07-16 12:20:04.632356258 +0000 UTC m=+1769.746789571"
Jul 16 12:20:06.703547 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:06.703510    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"]
Jul 16 12:20:06.707059 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:06.707024    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"
Jul 16 12:20:06.710220 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:06.710194    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:20:06.717064 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:06.717040    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"]
Jul 16 12:20:06.848125 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:06.848079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86fdb771-1832-4439-958b-75e3264bf3e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9\" (UID: \"86fdb771-1832-4439-958b-75e3264bf3e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"
Jul 16 12:20:06.864775 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:06.864731    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:06.930352 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:06.930284    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:06.949366 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:06.949331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86fdb771-1832-4439-958b-75e3264bf3e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9\" (UID: \"86fdb771-1832-4439-958b-75e3264bf3e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"
Jul 16 12:20:06.949937 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:06.949918    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86fdb771-1832-4439-958b-75e3264bf3e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9\" (UID: \"86fdb771-1832-4439-958b-75e3264bf3e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"
Jul 16 12:20:07.018594 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:07.018520    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"
Jul 16 12:20:07.152674 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:07.152646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"]
Jul 16 12:20:07.154671 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:20:07.154638    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fdb771_1832_4439_958b_75e3264bf3e5.slice/crio-72e0746c73045be253077fd1b3c218a6c70d4ce61a4eef89224a111eec98dc55 WatchSource:0}: Error finding container 72e0746c73045be253077fd1b3c218a6c70d4ce61a4eef89224a111eec98dc55: Status 404 returned error can't find the container with id 72e0746c73045be253077fd1b3c218a6c70d4ce61a4eef89224a111eec98dc55
Jul 16 12:20:07.626586 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:07.626489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9" event={"ID":"86fdb771-1832-4439-958b-75e3264bf3e5","Type":"ContainerStarted","Data":"6ea4d8a5025e51b7a37b322bbe763b4a24cc3b8935916e03dab878a1f5ebaee9"}
Jul 16 12:20:07.626586 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:07.626555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9" event={"ID":"86fdb771-1832-4439-958b-75e3264bf3e5","Type":"ContainerStarted","Data":"72e0746c73045be253077fd1b3c218a6c70d4ce61a4eef89224a111eec98dc55"}
Jul 16 12:20:07.646542 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:07.646489    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9" podStartSLOduration=1.646473568 podStartE2EDuration="1.646473568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:20:07.644381421 +0000 UTC m=+1772.758814708" watchObservedRunningTime="2026-07-16 12:20:07.646473568 +0000 UTC m=+1772.760906842"
Jul 16 12:20:08.633620 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:08.633588    2580 generic.go:356] "Generic (PLEG): container finished" podID="86fdb771-1832-4439-958b-75e3264bf3e5" containerID="6ea4d8a5025e51b7a37b322bbe763b4a24cc3b8935916e03dab878a1f5ebaee9" exitCode=7
Jul 16 12:20:08.634007 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:08.633670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9" event={"ID":"86fdb771-1832-4439-958b-75e3264bf3e5","Type":"ContainerDied","Data":"6ea4d8a5025e51b7a37b322bbe763b4a24cc3b8935916e03dab878a1f5ebaee9"}
Jul 16 12:20:08.634007 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:08.633848    2580 scope.go:117] "RemoveContainer" containerID="6ea4d8a5025e51b7a37b322bbe763b4a24cc3b8935916e03dab878a1f5ebaee9"
Jul 16 12:20:09.640750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:09.640710    2580 generic.go:356] "Generic (PLEG): container finished" podID="86fdb771-1832-4439-958b-75e3264bf3e5" containerID="5556965a3d5ca82af739c79c2ea891674a571dd90a0f8f79698a7e21102b2449" exitCode=7
Jul 16 12:20:09.641170 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:09.640797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9" event={"ID":"86fdb771-1832-4439-958b-75e3264bf3e5","Type":"ContainerDied","Data":"5556965a3d5ca82af739c79c2ea891674a571dd90a0f8f79698a7e21102b2449"}
Jul 16 12:20:09.641170 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:09.640860    2580 scope.go:117] "RemoveContainer" containerID="6ea4d8a5025e51b7a37b322bbe763b4a24cc3b8935916e03dab878a1f5ebaee9"
Jul 16 12:20:09.641170 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:09.641112    2580 scope.go:117] "RemoveContainer" containerID="5556965a3d5ca82af739c79c2ea891674a571dd90a0f8f79698a7e21102b2449"
Jul 16 12:20:09.641366 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:20:09.641342    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9_odh-ai-gateway-infra(86fdb771-1832-4439-958b-75e3264bf3e5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9" podUID="86fdb771-1832-4439-958b-75e3264bf3e5"
Jul 16 12:20:10.328554 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:10.328527    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:10.620443 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:10.620364    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:20:10.646671 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:10.646648    2580 scope.go:117] "RemoveContainer" containerID="5556965a3d5ca82af739c79c2ea891674a571dd90a0f8f79698a7e21102b2449"
Jul 16 12:20:10.647013 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:20:10.646837    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9_odh-ai-gateway-infra(86fdb771-1832-4439-958b-75e3264bf3e5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9" podUID="86fdb771-1832-4439-958b-75e3264bf3e5"
Jul 16 12:20:24.393915 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:24.393885    2580 scope.go:117] "RemoveContainer" containerID="5556965a3d5ca82af739c79c2ea891674a571dd90a0f8f79698a7e21102b2449"
Jul 16 12:20:24.718696 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:24.718663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9" event={"ID":"86fdb771-1832-4439-958b-75e3264bf3e5","Type":"ContainerStarted","Data":"bdb02c98858c90dfe687edd3c28e9519a9c36c3931ee86239cbd09bc0ab16c65"}
Jul 16 12:20:25.726038 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:25.726003    2580 generic.go:356] "Generic (PLEG): container finished" podID="86fdb771-1832-4439-958b-75e3264bf3e5" containerID="bdb02c98858c90dfe687edd3c28e9519a9c36c3931ee86239cbd09bc0ab16c65" exitCode=0
Jul 16 12:20:25.726444 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:25.726073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9" event={"ID":"86fdb771-1832-4439-958b-75e3264bf3e5","Type":"ContainerDied","Data":"bdb02c98858c90dfe687edd3c28e9519a9c36c3931ee86239cbd09bc0ab16c65"}
Jul 16 12:20:25.726444 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:25.726131    2580 scope.go:117] "RemoveContainer" containerID="5556965a3d5ca82af739c79c2ea891674a571dd90a0f8f79698a7e21102b2449"
Jul 16 12:20:25.773972 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:25.773946    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"]
Jul 16 12:20:26.864924 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:26.864899    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"
Jul 16 12:20:26.937504 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:26.937450    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86fdb771-1832-4439-958b-75e3264bf3e5-maas-api-service-ca\") pod \"86fdb771-1832-4439-958b-75e3264bf3e5\" (UID: \"86fdb771-1832-4439-958b-75e3264bf3e5\") "
Jul 16 12:20:26.937850 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:26.937827    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86fdb771-1832-4439-958b-75e3264bf3e5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "86fdb771-1832-4439-958b-75e3264bf3e5" (UID: "86fdb771-1832-4439-958b-75e3264bf3e5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:20:27.038444 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:27.038365    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/86fdb771-1832-4439-958b-75e3264bf3e5-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:20:27.739109 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:27.739025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9" event={"ID":"86fdb771-1832-4439-958b-75e3264bf3e5","Type":"ContainerDied","Data":"72e0746c73045be253077fd1b3c218a6c70d4ce61a4eef89224a111eec98dc55"}
Jul 16 12:20:27.739109 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:27.739086    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72e0746c73045be253077fd1b3c218a6c70d4ce61a4eef89224a111eec98dc55"
Jul 16 12:20:27.739285 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:27.739109    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"
Jul 16 12:20:27.775659 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:27.775630    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"]
Jul 16 12:20:27.779407 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:27.779379    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-5vgr9"]
Jul 16 12:20:29.399513 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:29.399480    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86fdb771-1832-4439-958b-75e3264bf3e5" path="/var/lib/kubelet/pods/86fdb771-1832-4439-958b-75e3264bf3e5/volumes"
Jul 16 12:20:35.477381 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:35.477346    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:20:35.480968 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:35.480940    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:20:35.481082 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:35.480998    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:20:35.484704 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:35.484684    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:20:52.189385 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:52.189351    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:20:55.752798 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:20:55.752762    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:03.365058 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:03.365022    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:03.465658 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:03.465623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:06.754239 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.754194    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4"]
Jul 16 12:21:06.754765 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.754638    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86fdb771-1832-4439-958b-75e3264bf3e5" containerName="revoke-keys"
Jul 16 12:21:06.754765 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.754654    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86fdb771-1832-4439-958b-75e3264bf3e5" containerName="revoke-keys"
Jul 16 12:21:06.754765 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.754681    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86fdb771-1832-4439-958b-75e3264bf3e5" containerName="revoke-keys"
Jul 16 12:21:06.754765 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.754687    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86fdb771-1832-4439-958b-75e3264bf3e5" containerName="revoke-keys"
Jul 16 12:21:06.754765 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.754762    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="86fdb771-1832-4439-958b-75e3264bf3e5" containerName="revoke-keys"
Jul 16 12:21:06.755033 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.754775    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="86fdb771-1832-4439-958b-75e3264bf3e5" containerName="revoke-keys"
Jul 16 12:21:06.757868 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.757845    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4"
Jul 16 12:21:06.760365 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.760342    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:21:06.766133 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.765777    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4"]
Jul 16 12:21:06.801710 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.801674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27a69958-11bc-474e-a7b1-67c0c35b4920-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4\" (UID: \"27a69958-11bc-474e-a7b1-67c0c35b4920\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4"
Jul 16 12:21:06.855756 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.855715    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:06.903019 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.902980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27a69958-11bc-474e-a7b1-67c0c35b4920-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4\" (UID: \"27a69958-11bc-474e-a7b1-67c0c35b4920\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4"
Jul 16 12:21:06.903628 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.903609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27a69958-11bc-474e-a7b1-67c0c35b4920-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4\" (UID: \"27a69958-11bc-474e-a7b1-67c0c35b4920\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4"
Jul 16 12:21:06.971192 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:06.971120    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:07.070159 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:07.070059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4"
Jul 16 12:21:07.204747 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:07.204721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4"]
Jul 16 12:21:07.207237 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:21:07.207211    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a69958_11bc_474e_a7b1_67c0c35b4920.slice/crio-c6acbcf50b254ae83e2c9da3964240db92371de4472b0c7c94f9068279acc23c WatchSource:0}: Error finding container c6acbcf50b254ae83e2c9da3964240db92371de4472b0c7c94f9068279acc23c: Status 404 returned error can't find the container with id c6acbcf50b254ae83e2c9da3964240db92371de4472b0c7c94f9068279acc23c
Jul 16 12:21:07.320668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:07.320581    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:07.421116 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:07.421082    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:07.932156 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:07.932122    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4" event={"ID":"27a69958-11bc-474e-a7b1-67c0c35b4920","Type":"ContainerStarted","Data":"516f59720855dd109ec2649d5117be645683dff720160efc425a0d3baddde3f3"}
Jul 16 12:21:07.932571 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:07.932174    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4" event={"ID":"27a69958-11bc-474e-a7b1-67c0c35b4920","Type":"ContainerStarted","Data":"c6acbcf50b254ae83e2c9da3964240db92371de4472b0c7c94f9068279acc23c"}
Jul 16 12:21:07.948772 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:07.948719    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4" podStartSLOduration=1.948702382 podStartE2EDuration="1.948702382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:07.948074529 +0000 UTC m=+1833.062507804" watchObservedRunningTime="2026-07-16 12:21:07.948702382 +0000 UTC m=+1833.063135658"
Jul 16 12:21:08.938647 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:08.938604    2580 generic.go:356] "Generic (PLEG): container finished" podID="27a69958-11bc-474e-a7b1-67c0c35b4920" containerID="516f59720855dd109ec2649d5117be645683dff720160efc425a0d3baddde3f3" exitCode=0
Jul 16 12:21:08.939038 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:08.938679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4" event={"ID":"27a69958-11bc-474e-a7b1-67c0c35b4920","Type":"ContainerDied","Data":"516f59720855dd109ec2649d5117be645683dff720160efc425a0d3baddde3f3"}
Jul 16 12:21:10.079799 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:10.079766    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4"
Jul 16 12:21:10.137355 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:10.137322    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27a69958-11bc-474e-a7b1-67c0c35b4920-maas-api-service-ca\") pod \"27a69958-11bc-474e-a7b1-67c0c35b4920\" (UID: \"27a69958-11bc-474e-a7b1-67c0c35b4920\") "
Jul 16 12:21:10.137749 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:10.137726    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a69958-11bc-474e-a7b1-67c0c35b4920-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27a69958-11bc-474e-a7b1-67c0c35b4920" (UID: "27a69958-11bc-474e-a7b1-67c0c35b4920"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:21:10.238023 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:10.237938    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27a69958-11bc-474e-a7b1-67c0c35b4920-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:21:10.949695 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:10.949663    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4"
Jul 16 12:21:10.949894 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:10.949706    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4" event={"ID":"27a69958-11bc-474e-a7b1-67c0c35b4920","Type":"ContainerDied","Data":"c6acbcf50b254ae83e2c9da3964240db92371de4472b0c7c94f9068279acc23c"}
Jul 16 12:21:10.949894 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:10.949779    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6acbcf50b254ae83e2c9da3964240db92371de4472b0c7c94f9068279acc23c"
Jul 16 12:21:12.287353 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.287319    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"]
Jul 16 12:21:12.287850 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.287536    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs" podUID="651c523e-c2fc-4d03-8a1e-28579e770d5c" containerName="maas-api" containerID="cri-o://5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd" gracePeriod=30
Jul 16 12:21:12.312739 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.312711    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:12.537287 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.537260    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:21:12.660324 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.660291    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f54cf\" (UniqueName: \"kubernetes.io/projected/651c523e-c2fc-4d03-8a1e-28579e770d5c-kube-api-access-f54cf\") pod \"651c523e-c2fc-4d03-8a1e-28579e770d5c\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") "
Jul 16 12:21:12.660523 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.660366    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/651c523e-c2fc-4d03-8a1e-28579e770d5c-openshift-service-ca\") pod \"651c523e-c2fc-4d03-8a1e-28579e770d5c\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") "
Jul 16 12:21:12.660523 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.660419    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/651c523e-c2fc-4d03-8a1e-28579e770d5c-maas-api-tls\") pod \"651c523e-c2fc-4d03-8a1e-28579e770d5c\" (UID: \"651c523e-c2fc-4d03-8a1e-28579e770d5c\") "
Jul 16 12:21:12.660751 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.660725    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/651c523e-c2fc-4d03-8a1e-28579e770d5c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "651c523e-c2fc-4d03-8a1e-28579e770d5c" (UID: "651c523e-c2fc-4d03-8a1e-28579e770d5c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:21:12.662656 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.662631    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/651c523e-c2fc-4d03-8a1e-28579e770d5c-kube-api-access-f54cf" (OuterVolumeSpecName: "kube-api-access-f54cf") pod "651c523e-c2fc-4d03-8a1e-28579e770d5c" (UID: "651c523e-c2fc-4d03-8a1e-28579e770d5c"). InnerVolumeSpecName "kube-api-access-f54cf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:21:12.662756 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.662723    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/651c523e-c2fc-4d03-8a1e-28579e770d5c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "651c523e-c2fc-4d03-8a1e-28579e770d5c" (UID: "651c523e-c2fc-4d03-8a1e-28579e770d5c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:21:12.761653 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.761570    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f54cf\" (UniqueName: \"kubernetes.io/projected/651c523e-c2fc-4d03-8a1e-28579e770d5c-kube-api-access-f54cf\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:21:12.761653 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.761595    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/651c523e-c2fc-4d03-8a1e-28579e770d5c-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:21:12.761653 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.761606    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/651c523e-c2fc-4d03-8a1e-28579e770d5c-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:21:12.962232 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.962196    2580 generic.go:356] "Generic (PLEG): container finished" podID="651c523e-c2fc-4d03-8a1e-28579e770d5c" containerID="5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd" exitCode=0
Jul 16 12:21:12.962425 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.962241    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs" event={"ID":"651c523e-c2fc-4d03-8a1e-28579e770d5c","Type":"ContainerDied","Data":"5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd"}
Jul 16 12:21:12.962425 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.962304    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs" event={"ID":"651c523e-c2fc-4d03-8a1e-28579e770d5c","Type":"ContainerDied","Data":"7b1f7ae8965d66ab7c85f58758b3948e4e654a3cbfca882b6c00a03c3bdd4cfe"}
Jul 16 12:21:12.962425 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.962332    2580 scope.go:117] "RemoveContainer" containerID="5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd"
Jul 16 12:21:12.962425 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.962251    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"
Jul 16 12:21:12.971805 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.971768    2580 scope.go:117] "RemoveContainer" containerID="5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd"
Jul 16 12:21:12.972056 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:21:12.972039    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd\": container with ID starting with 5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd not found: ID does not exist" containerID="5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd"
Jul 16 12:21:12.972113 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.972069    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd"} err="failed to get container status \"5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd\": rpc error: code = NotFound desc = could not find container \"5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd\": container with ID starting with 5d86d1119fe2da8fc0c225ca970ee1468c2ca40e854ffa6c42361b8940f16afd not found: ID does not exist"
Jul 16 12:21:12.986130 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.986101    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"]
Jul 16 12:21:12.994358 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:12.994331    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-953cf885-57dc9c889b-hkpgs"]
Jul 16 12:21:13.268760 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:13.268706    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:13.369944 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:13.369910    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:13.400996 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:13.400961    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="651c523e-c2fc-4d03-8a1e-28579e770d5c" path="/var/lib/kubelet/pods/651c523e-c2fc-4d03-8a1e-28579e770d5c/volumes"
Jul 16 12:21:19.219526 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:19.219489    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:19.296611 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:19.296571    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:19.520976 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:19.520940    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:19.816774 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:19.816679    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:20.684771 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.684738    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:20.982241 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.982162    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"]
Jul 16 12:21:20.982623 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.982610    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="651c523e-c2fc-4d03-8a1e-28579e770d5c" containerName="maas-api"
Jul 16 12:21:20.982674 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.982627    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="651c523e-c2fc-4d03-8a1e-28579e770d5c" containerName="maas-api"
Jul 16 12:21:20.982674 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.982635    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86fdb771-1832-4439-958b-75e3264bf3e5" containerName="revoke-keys"
Jul 16 12:21:20.982674 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.982642    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86fdb771-1832-4439-958b-75e3264bf3e5" containerName="revoke-keys"
Jul 16 12:21:20.982674 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.982656    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a69958-11bc-474e-a7b1-67c0c35b4920" containerName="revoke-keys"
Jul 16 12:21:20.982674 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.982662    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a69958-11bc-474e-a7b1-67c0c35b4920" containerName="revoke-keys"
Jul 16 12:21:20.982825 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.982737    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a69958-11bc-474e-a7b1-67c0c35b4920" containerName="revoke-keys"
Jul 16 12:21:20.982825 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.982746    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="651c523e-c2fc-4d03-8a1e-28579e770d5c" containerName="maas-api"
Jul 16 12:21:20.982825 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.982754    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="86fdb771-1832-4439-958b-75e3264bf3e5" containerName="revoke-keys"
Jul 16 12:21:20.987482 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.987447    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:20.991320 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:20.991296    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-05da2a54-serving-cert\""
Jul 16 12:21:21.003522 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.003493    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"]
Jul 16 12:21:21.039425 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.039389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21023ac3-b590-4e9d-8d29-46737f9c3a78-maas-api-tls\") pod \"maas-api-e2e-ait-05da2a54-5d55957966-99hz5\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:21.039425 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.039428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w96dh\" (UniqueName: \"kubernetes.io/projected/21023ac3-b590-4e9d-8d29-46737f9c3a78-kube-api-access-w96dh\") pod \"maas-api-e2e-ait-05da2a54-5d55957966-99hz5\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:21.039667 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.039564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21023ac3-b590-4e9d-8d29-46737f9c3a78-openshift-service-ca\") pod \"maas-api-e2e-ait-05da2a54-5d55957966-99hz5\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:21.124390 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.124352    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:21.140735 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.140700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21023ac3-b590-4e9d-8d29-46737f9c3a78-openshift-service-ca\") pod \"maas-api-e2e-ait-05da2a54-5d55957966-99hz5\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:21.140904 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.140754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21023ac3-b590-4e9d-8d29-46737f9c3a78-maas-api-tls\") pod \"maas-api-e2e-ait-05da2a54-5d55957966-99hz5\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:21.140904 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.140776    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w96dh\" (UniqueName: \"kubernetes.io/projected/21023ac3-b590-4e9d-8d29-46737f9c3a78-kube-api-access-w96dh\") pod \"maas-api-e2e-ait-05da2a54-5d55957966-99hz5\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:21.141507 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.141489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21023ac3-b590-4e9d-8d29-46737f9c3a78-openshift-service-ca\") pod \"maas-api-e2e-ait-05da2a54-5d55957966-99hz5\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:21.143392 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.143372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21023ac3-b590-4e9d-8d29-46737f9c3a78-maas-api-tls\") pod \"maas-api-e2e-ait-05da2a54-5d55957966-99hz5\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:21.160357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.160326    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w96dh\" (UniqueName: \"kubernetes.io/projected/21023ac3-b590-4e9d-8d29-46737f9c3a78-kube-api-access-w96dh\") pod \"maas-api-e2e-ait-05da2a54-5d55957966-99hz5\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:21.227919 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.227877    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:21.298827 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.298730    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:21.442740 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.442709    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"]
Jul 16 12:21:21.444515 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:21:21.444486    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21023ac3_b590_4e9d_8d29_46737f9c3a78.slice/crio-fe672087af9cbed5a6749f8e754f872917d418242727a45eb7792dcb35786e6c WatchSource:0}: Error finding container fe672087af9cbed5a6749f8e754f872917d418242727a45eb7792dcb35786e6c: Status 404 returned error can't find the container with id fe672087af9cbed5a6749f8e754f872917d418242727a45eb7792dcb35786e6c
Jul 16 12:21:21.668161 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.668120    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:21.768978 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:21.768939    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:22.010686 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:22.010599    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5" event={"ID":"21023ac3-b590-4e9d-8d29-46737f9c3a78","Type":"ContainerStarted","Data":"fe672087af9cbed5a6749f8e754f872917d418242727a45eb7792dcb35786e6c"}
Jul 16 12:21:22.970094 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:22.970057    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:21:23.017448 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:23.017411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5" event={"ID":"21023ac3-b590-4e9d-8d29-46737f9c3a78","Type":"ContainerStarted","Data":"eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9"}
Jul 16 12:21:23.017655 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:23.017573    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:23.037680 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:23.037620    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5" podStartSLOduration=2.215774276 podStartE2EDuration="3.03760254s" totalImagesPullingTime="821.828264ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:23.035195449 +0000 UTC m=+1848.149628726" watchObservedRunningTime="2026-07-16 12:21:23.03760254 +0000 UTC m=+1848.152035817"
Jul 16 12:21:25.734021 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:25.733987    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"]
Jul 16 12:21:25.737381 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:25.737361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"
Jul 16 12:21:25.740305 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:25.740286    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:21:25.746152 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:25.746131    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"]
Jul 16 12:21:25.888039 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:25.888007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d7c892-0251-4532-82ed-beac7a6bb3fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-05da2a54-g47cw\" (UID: \"a6d7c892-0251-4532-82ed-beac7a6bb3fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"
Jul 16 12:21:25.989482 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:25.989363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d7c892-0251-4532-82ed-beac7a6bb3fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-05da2a54-g47cw\" (UID: \"a6d7c892-0251-4532-82ed-beac7a6bb3fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"
Jul 16 12:21:25.990027 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:25.990007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d7c892-0251-4532-82ed-beac7a6bb3fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-05da2a54-g47cw\" (UID: \"a6d7c892-0251-4532-82ed-beac7a6bb3fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"
Jul 16 12:21:26.049415 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:26.049383    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"
Jul 16 12:21:26.207070 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:26.207043    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"]
Jul 16 12:21:26.209160 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:21:26.209114    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d7c892_0251_4532_82ed_beac7a6bb3fb.slice/crio-82a7a814da3729039f48c2b6e1355c5a86074ec548eae6e0d7a14208e5abb0da WatchSource:0}: Error finding container 82a7a814da3729039f48c2b6e1355c5a86074ec548eae6e0d7a14208e5abb0da: Status 404 returned error can't find the container with id 82a7a814da3729039f48c2b6e1355c5a86074ec548eae6e0d7a14208e5abb0da
Jul 16 12:21:27.038655 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:27.038560    2580 generic.go:356] "Generic (PLEG): container finished" podID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerID="baddfa993ed8859cc8c69b92279531783347aa0666515176c71557986258c0b1" exitCode=7
Jul 16 12:21:27.039082 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:27.038651    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw" event={"ID":"a6d7c892-0251-4532-82ed-beac7a6bb3fb","Type":"ContainerDied","Data":"baddfa993ed8859cc8c69b92279531783347aa0666515176c71557986258c0b1"}
Jul 16 12:21:27.039082 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:27.038736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw" event={"ID":"a6d7c892-0251-4532-82ed-beac7a6bb3fb","Type":"ContainerStarted","Data":"82a7a814da3729039f48c2b6e1355c5a86074ec548eae6e0d7a14208e5abb0da"}
Jul 16 12:21:27.039082 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:27.038880    2580 scope.go:117] "RemoveContainer" containerID="baddfa993ed8859cc8c69b92279531783347aa0666515176c71557986258c0b1"
Jul 16 12:21:28.045574 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:28.045449    2580 generic.go:356] "Generic (PLEG): container finished" podID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerID="41d93d787f0f376060239b679b0d2ce6948f1d0bd0fe10e1a4aa6ede8163660b" exitCode=7
Jul 16 12:21:28.045574 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:28.045532    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw" event={"ID":"a6d7c892-0251-4532-82ed-beac7a6bb3fb","Type":"ContainerDied","Data":"41d93d787f0f376060239b679b0d2ce6948f1d0bd0fe10e1a4aa6ede8163660b"}
Jul 16 12:21:28.046035 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:28.045593    2580 scope.go:117] "RemoveContainer" containerID="baddfa993ed8859cc8c69b92279531783347aa0666515176c71557986258c0b1"
Jul 16 12:21:28.046035 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:28.045741    2580 scope.go:117] "RemoveContainer" containerID="41d93d787f0f376060239b679b0d2ce6948f1d0bd0fe10e1a4aa6ede8163660b"
Jul 16 12:21:28.046035 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:21:28.046017    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-05da2a54-g47cw_odh-ai-gateway-infra(a6d7c892-0251-4532-82ed-beac7a6bb3fb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb"
Jul 16 12:21:29.028268 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:29.028237    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:21:29.052473 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:29.052430    2580 scope.go:117] "RemoveContainer" containerID="41d93d787f0f376060239b679b0d2ce6948f1d0bd0fe10e1a4aa6ede8163660b"
Jul 16 12:21:29.052854 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:21:29.052650    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-05da2a54-g47cw_odh-ai-gateway-infra(a6d7c892-0251-4532-82ed-beac7a6bb3fb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb"
Jul 16 12:21:42.393638 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:42.393604    2580 scope.go:117] "RemoveContainer" containerID="41d93d787f0f376060239b679b0d2ce6948f1d0bd0fe10e1a4aa6ede8163660b"
Jul 16 12:21:43.126172 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:43.126137    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw" event={"ID":"a6d7c892-0251-4532-82ed-beac7a6bb3fb","Type":"ContainerStarted","Data":"49cc147b23082af0801a4b280d7d9642be59b60778672be1338608354ad6a77f"}
Jul 16 12:21:43.141413 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:43.141364    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw" podStartSLOduration=18.141349126 podStartE2EDuration="18.141349126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:21:43.140151406 +0000 UTC m=+1868.254584683" watchObservedRunningTime="2026-07-16 12:21:43.141349126 +0000 UTC m=+1868.255782401"
Jul 16 12:21:44.139738 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:44.139703    2580 generic.go:356] "Generic (PLEG): container finished" podID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerID="49cc147b23082af0801a4b280d7d9642be59b60778672be1338608354ad6a77f" exitCode=0
Jul 16 12:21:44.140175 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:44.139742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw" event={"ID":"a6d7c892-0251-4532-82ed-beac7a6bb3fb","Type":"ContainerDied","Data":"49cc147b23082af0801a4b280d7d9642be59b60778672be1338608354ad6a77f"}
Jul 16 12:21:44.140175 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:44.139840    2580 scope.go:117] "RemoveContainer" containerID="41d93d787f0f376060239b679b0d2ce6948f1d0bd0fe10e1a4aa6ede8163660b"
Jul 16 12:21:44.150642 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:44.150618    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"]
Jul 16 12:21:45.284363 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:45.284333    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"
Jul 16 12:21:45.468199 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:45.468119    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d7c892-0251-4532-82ed-beac7a6bb3fb-maas-api-service-ca\") pod \"a6d7c892-0251-4532-82ed-beac7a6bb3fb\" (UID: \"a6d7c892-0251-4532-82ed-beac7a6bb3fb\") "
Jul 16 12:21:45.468538 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:45.468511    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6d7c892-0251-4532-82ed-beac7a6bb3fb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a6d7c892-0251-4532-82ed-beac7a6bb3fb" (UID: "a6d7c892-0251-4532-82ed-beac7a6bb3fb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:21:45.568981 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:45.568939    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6d7c892-0251-4532-82ed-beac7a6bb3fb-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:21:46.152928 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:46.152895    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"
Jul 16 12:21:46.153132 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:46.152894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw" event={"ID":"a6d7c892-0251-4532-82ed-beac7a6bb3fb","Type":"ContainerDied","Data":"82a7a814da3729039f48c2b6e1355c5a86074ec548eae6e0d7a14208e5abb0da"}
Jul 16 12:21:46.153132 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:46.153022    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82a7a814da3729039f48c2b6e1355c5a86074ec548eae6e0d7a14208e5abb0da"
Jul 16 12:21:46.186998 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:46.186965    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"]
Jul 16 12:21:46.191067 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:46.191041    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-g47cw"]
Jul 16 12:21:47.401145 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:47.401101    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" path="/var/lib/kubelet/pods/a6d7c892-0251-4532-82ed-beac7a6bb3fb/volumes"
Jul 16 12:21:55.779133 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:21:55.779060    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:25.794002 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:25.793963    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw"]
Jul 16 12:22:25.794750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:25.794361    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerName="revoke-keys"
Jul 16 12:22:25.794750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:25.794374    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerName="revoke-keys"
Jul 16 12:22:25.794750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:25.794382    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerName="revoke-keys"
Jul 16 12:22:25.794750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:25.794388    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerName="revoke-keys"
Jul 16 12:22:25.794750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:25.794481    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerName="revoke-keys"
Jul 16 12:22:25.794750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:25.794489    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerName="revoke-keys"
Jul 16 12:22:25.797858 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:25.797836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw"
Jul 16 12:22:25.800370 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:25.800346    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:22:25.811077 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:25.811048    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw"]
Jul 16 12:22:25.942331 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:25.942298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d18b9fe1-c260-4a28-aed0-329753baf92b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-05da2a54-w92qw\" (UID: \"d18b9fe1-c260-4a28-aed0-329753baf92b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw"
Jul 16 12:22:26.043359 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:26.043326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d18b9fe1-c260-4a28-aed0-329753baf92b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-05da2a54-w92qw\" (UID: \"d18b9fe1-c260-4a28-aed0-329753baf92b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw"
Jul 16 12:22:26.044001 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:26.043980    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d18b9fe1-c260-4a28-aed0-329753baf92b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-05da2a54-w92qw\" (UID: \"d18b9fe1-c260-4a28-aed0-329753baf92b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw"
Jul 16 12:22:26.109598 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:26.109512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw"
Jul 16 12:22:26.251416 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:26.251384    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw"]
Jul 16 12:22:26.252613 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:22:26.252587    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd18b9fe1_c260_4a28_aed0_329753baf92b.slice/crio-9215dcc0f9b938c42f1aa23bb57456c2db030c45e006766a2e9f1f9cf9bd718c WatchSource:0}: Error finding container 9215dcc0f9b938c42f1aa23bb57456c2db030c45e006766a2e9f1f9cf9bd718c: Status 404 returned error can't find the container with id 9215dcc0f9b938c42f1aa23bb57456c2db030c45e006766a2e9f1f9cf9bd718c
Jul 16 12:22:26.357470 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:26.357433    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw" event={"ID":"d18b9fe1-c260-4a28-aed0-329753baf92b","Type":"ContainerStarted","Data":"9215dcc0f9b938c42f1aa23bb57456c2db030c45e006766a2e9f1f9cf9bd718c"}
Jul 16 12:22:27.364635 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:27.364549    2580 generic.go:356] "Generic (PLEG): container finished" podID="d18b9fe1-c260-4a28-aed0-329753baf92b" containerID="f9216eeea0692577941da22a1b083af54b1ba2d24ff54a82d70df465d4c00380" exitCode=0
Jul 16 12:22:27.364991 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:27.364638    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw" event={"ID":"d18b9fe1-c260-4a28-aed0-329753baf92b","Type":"ContainerDied","Data":"f9216eeea0692577941da22a1b083af54b1ba2d24ff54a82d70df465d4c00380"}
Jul 16 12:22:28.505302 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:28.505275    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw"
Jul 16 12:22:28.567346 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:28.567311    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d18b9fe1-c260-4a28-aed0-329753baf92b-maas-api-service-ca\") pod \"d18b9fe1-c260-4a28-aed0-329753baf92b\" (UID: \"d18b9fe1-c260-4a28-aed0-329753baf92b\") "
Jul 16 12:22:28.567725 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:28.567703    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d18b9fe1-c260-4a28-aed0-329753baf92b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d18b9fe1-c260-4a28-aed0-329753baf92b" (UID: "d18b9fe1-c260-4a28-aed0-329753baf92b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:22:28.668085 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:28.668056    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d18b9fe1-c260-4a28-aed0-329753baf92b-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:22:29.375384 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:29.375357    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw"
Jul 16 12:22:29.375595 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:29.375352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-05da2a54-w92qw" event={"ID":"d18b9fe1-c260-4a28-aed0-329753baf92b","Type":"ContainerDied","Data":"9215dcc0f9b938c42f1aa23bb57456c2db030c45e006766a2e9f1f9cf9bd718c"}
Jul 16 12:22:29.375595 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:29.375535    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9215dcc0f9b938c42f1aa23bb57456c2db030c45e006766a2e9f1f9cf9bd718c"
Jul 16 12:22:36.349152 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.349114    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"]
Jul 16 12:22:36.349589 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.349369    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5" podUID="21023ac3-b590-4e9d-8d29-46737f9c3a78" containerName="maas-api" containerID="cri-o://eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9" gracePeriod=30
Jul 16 12:22:36.380333 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.380301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:36.595056 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.595025    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:22:36.641475 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.641430    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21023ac3-b590-4e9d-8d29-46737f9c3a78-maas-api-tls\") pod \"21023ac3-b590-4e9d-8d29-46737f9c3a78\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") "
Jul 16 12:22:36.641652 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.641522    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21023ac3-b590-4e9d-8d29-46737f9c3a78-openshift-service-ca\") pod \"21023ac3-b590-4e9d-8d29-46737f9c3a78\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") "
Jul 16 12:22:36.641721 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.641659    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w96dh\" (UniqueName: \"kubernetes.io/projected/21023ac3-b590-4e9d-8d29-46737f9c3a78-kube-api-access-w96dh\") pod \"21023ac3-b590-4e9d-8d29-46737f9c3a78\" (UID: \"21023ac3-b590-4e9d-8d29-46737f9c3a78\") "
Jul 16 12:22:36.641885 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.641860    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21023ac3-b590-4e9d-8d29-46737f9c3a78-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21023ac3-b590-4e9d-8d29-46737f9c3a78" (UID: "21023ac3-b590-4e9d-8d29-46737f9c3a78"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:22:36.643568 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.643543    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21023ac3-b590-4e9d-8d29-46737f9c3a78-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21023ac3-b590-4e9d-8d29-46737f9c3a78" (UID: "21023ac3-b590-4e9d-8d29-46737f9c3a78"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:22:36.643762 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.643742    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21023ac3-b590-4e9d-8d29-46737f9c3a78-kube-api-access-w96dh" (OuterVolumeSpecName: "kube-api-access-w96dh") pod "21023ac3-b590-4e9d-8d29-46737f9c3a78" (UID: "21023ac3-b590-4e9d-8d29-46737f9c3a78"). InnerVolumeSpecName "kube-api-access-w96dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:22:36.742814 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.742778    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w96dh\" (UniqueName: \"kubernetes.io/projected/21023ac3-b590-4e9d-8d29-46737f9c3a78-kube-api-access-w96dh\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:22:36.742814 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.742807    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21023ac3-b590-4e9d-8d29-46737f9c3a78-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:22:36.742814 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:36.742818    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21023ac3-b590-4e9d-8d29-46737f9c3a78-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:22:37.421061 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:37.421029    2580 generic.go:356] "Generic (PLEG): container finished" podID="21023ac3-b590-4e9d-8d29-46737f9c3a78" containerID="eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9" exitCode=0
Jul 16 12:22:37.421488 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:37.421078    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"
Jul 16 12:22:37.421488 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:37.421115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5" event={"ID":"21023ac3-b590-4e9d-8d29-46737f9c3a78","Type":"ContainerDied","Data":"eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9"}
Jul 16 12:22:37.421488 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:37.421162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5" event={"ID":"21023ac3-b590-4e9d-8d29-46737f9c3a78","Type":"ContainerDied","Data":"fe672087af9cbed5a6749f8e754f872917d418242727a45eb7792dcb35786e6c"}
Jul 16 12:22:37.421488 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:37.421190    2580 scope.go:117] "RemoveContainer" containerID="eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9"
Jul 16 12:22:37.429907 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:37.429883    2580 scope.go:117] "RemoveContainer" containerID="eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9"
Jul 16 12:22:37.430215 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:22:37.430195    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9\": container with ID starting with eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9 not found: ID does not exist" containerID="eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9"
Jul 16 12:22:37.430270 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:37.430225    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9"} err="failed to get container status \"eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9\": rpc error: code = NotFound desc = could not find container \"eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9\": container with ID starting with eb97a1778d675e50be48a280e9e4a56e8c4fda42b3ffafd2a83444ae5e8fbcf9 not found: ID does not exist"
Jul 16 12:22:37.441035 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:37.441006    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"]
Jul 16 12:22:37.444899 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:37.444875    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05da2a54-5d55957966-99hz5"]
Jul 16 12:22:39.399877 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:39.399840    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21023ac3-b590-4e9d-8d29-46737f9c3a78" path="/var/lib/kubelet/pods/21023ac3-b590-4e9d-8d29-46737f9c3a78/volumes"
Jul 16 12:22:40.879907 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:40.879870    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:47.152374 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:47.152328    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:47.276801 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:47.276771    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:52.001643 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:52.001606    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:52.352805 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:52.352767    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:53.493172 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.493134    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:53.604029 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.603994    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"]
Jul 16 12:22:53.604503 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.604484    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerName="revoke-keys"
Jul 16 12:22:53.604596 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.604505    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerName="revoke-keys"
Jul 16 12:22:53.604596 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.604522    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21023ac3-b590-4e9d-8d29-46737f9c3a78" containerName="maas-api"
Jul 16 12:22:53.604596 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.604530    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="21023ac3-b590-4e9d-8d29-46737f9c3a78" containerName="maas-api"
Jul 16 12:22:53.604596 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.604544    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d18b9fe1-c260-4a28-aed0-329753baf92b" containerName="revoke-keys"
Jul 16 12:22:53.604596 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.604552    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d18b9fe1-c260-4a28-aed0-329753baf92b" containerName="revoke-keys"
Jul 16 12:22:53.604842 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.604665    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d18b9fe1-c260-4a28-aed0-329753baf92b" containerName="revoke-keys"
Jul 16 12:22:53.604842 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.604679    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="21023ac3-b590-4e9d-8d29-46737f9c3a78" containerName="maas-api"
Jul 16 12:22:53.604842 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.604689    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6d7c892-0251-4532-82ed-beac7a6bb3fb" containerName="revoke-keys"
Jul 16 12:22:53.607723 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.607703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:53.611452 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.611430    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-26cae25e-serving-cert\""
Jul 16 12:22:53.622676 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.622650    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"]
Jul 16 12:22:53.691252 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.691216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1abb52e-42bb-466d-8610-88f93248d310-maas-api-tls\") pod \"maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:53.691252 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.691251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m8jt\" (UniqueName: \"kubernetes.io/projected/d1abb52e-42bb-466d-8610-88f93248d310-kube-api-access-6m8jt\") pod \"maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:53.691519 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.691292    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1abb52e-42bb-466d-8610-88f93248d310-openshift-service-ca\") pod \"maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:53.792004 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.791905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1abb52e-42bb-466d-8610-88f93248d310-maas-api-tls\") pod \"maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:53.792004 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.791946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m8jt\" (UniqueName: \"kubernetes.io/projected/d1abb52e-42bb-466d-8610-88f93248d310-kube-api-access-6m8jt\") pod \"maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:53.792004 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.792000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1abb52e-42bb-466d-8610-88f93248d310-openshift-service-ca\") pod \"maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:53.792304 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:22:53.792098    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-serving-cert: secret "maas-api-e2e-derive-26cae25e-serving-cert" not found
Jul 16 12:22:53.792304 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:22:53.792172    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1abb52e-42bb-466d-8610-88f93248d310-maas-api-tls podName:d1abb52e-42bb-466d-8610-88f93248d310 nodeName:}" failed. No retries permitted until 2026-07-16 12:22:54.292153369 +0000 UTC m=+1939.406586624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1abb52e-42bb-466d-8610-88f93248d310-maas-api-tls") pod "maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8" (UID: "d1abb52e-42bb-466d-8610-88f93248d310") : secret "maas-api-e2e-derive-26cae25e-serving-cert" not found
Jul 16 12:22:53.792697 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.792678    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1abb52e-42bb-466d-8610-88f93248d310-openshift-service-ca\") pod \"maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:53.807853 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:53.807821    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m8jt\" (UniqueName: \"kubernetes.io/projected/d1abb52e-42bb-466d-8610-88f93248d310-kube-api-access-6m8jt\") pod \"maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:54.279139 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:54.279091    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:54.297499 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:54.297436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1abb52e-42bb-466d-8610-88f93248d310-maas-api-tls\") pod \"maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:54.300041 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:54.300016    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1abb52e-42bb-466d-8610-88f93248d310-maas-api-tls\") pod \"maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:54.456168 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:54.456130    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:54.519361 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:54.519330    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:54.670295 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:54.670230    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"]
Jul 16 12:22:54.672659 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:22:54.672628    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1abb52e_42bb_466d_8610_88f93248d310.slice/crio-640aae9afd2706c6f0dfb6b9e85fe431a5687d850f865ba56a28a24f6802aa80 WatchSource:0}: Error finding container 640aae9afd2706c6f0dfb6b9e85fe431a5687d850f865ba56a28a24f6802aa80: Status 404 returned error can't find the container with id 640aae9afd2706c6f0dfb6b9e85fe431a5687d850f865ba56a28a24f6802aa80
Jul 16 12:22:55.510199 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:55.510110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8" event={"ID":"d1abb52e-42bb-466d-8610-88f93248d310","Type":"ContainerStarted","Data":"37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129"}
Jul 16 12:22:55.510199 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:55.510163    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8" event={"ID":"d1abb52e-42bb-466d-8610-88f93248d310","Type":"ContainerStarted","Data":"640aae9afd2706c6f0dfb6b9e85fe431a5687d850f865ba56a28a24f6802aa80"}
Jul 16 12:22:55.510386 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:55.510233    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:22:55.536195 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:55.536153    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8" podStartSLOduration=2.067160928 podStartE2EDuration="2.536139565s" totalImagesPullingTime="468.978637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:22:55.534394256 +0000 UTC m=+1940.648827544" watchObservedRunningTime="2026-07-16 12:22:55.536139565 +0000 UTC m=+1940.650572840"
Jul 16 12:22:57.884191 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:57.884149    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"]
Jul 16 12:22:57.887870 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:57.887854    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"
Jul 16 12:22:57.890445 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:57.890427    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:22:57.897411 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:57.897388    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"]
Jul 16 12:22:58.032502 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:58.032438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7485ae32-16f7-4453-ac9e-8ed9fc894792-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq\" (UID: \"7485ae32-16f7-4453-ac9e-8ed9fc894792\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"
Jul 16 12:22:58.133108 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:58.133071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7485ae32-16f7-4453-ac9e-8ed9fc894792-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq\" (UID: \"7485ae32-16f7-4453-ac9e-8ed9fc894792\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"
Jul 16 12:22:58.133698 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:58.133678    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7485ae32-16f7-4453-ac9e-8ed9fc894792-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq\" (UID: \"7485ae32-16f7-4453-ac9e-8ed9fc894792\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"
Jul 16 12:22:58.198922 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:58.198843    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"
Jul 16 12:22:58.345755 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:58.345723    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"]
Jul 16 12:22:58.346473 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:22:58.346422    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7485ae32_16f7_4453_ac9e_8ed9fc894792.slice/crio-564464cad10eabd7664b7c43140415f8f84c8a6bf714bc41b27ffd08ddba00be WatchSource:0}: Error finding container 564464cad10eabd7664b7c43140415f8f84c8a6bf714bc41b27ffd08ddba00be: Status 404 returned error can't find the container with id 564464cad10eabd7664b7c43140415f8f84c8a6bf714bc41b27ffd08ddba00be
Jul 16 12:22:58.374560 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:58.374535    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:58.475705 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:58.475627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:22:58.532229 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:58.532185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq" event={"ID":"7485ae32-16f7-4453-ac9e-8ed9fc894792","Type":"ContainerStarted","Data":"564464cad10eabd7664b7c43140415f8f84c8a6bf714bc41b27ffd08ddba00be"}
Jul 16 12:22:59.538834 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:59.538798    2580 generic.go:356] "Generic (PLEG): container finished" podID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerID="07ad45ae46be24ac6d7000afd31013567b24bcedbcccb8eb9d63930d2f36ff6b" exitCode=7
Jul 16 12:22:59.539245 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:59.538848    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq" event={"ID":"7485ae32-16f7-4453-ac9e-8ed9fc894792","Type":"ContainerDied","Data":"07ad45ae46be24ac6d7000afd31013567b24bcedbcccb8eb9d63930d2f36ff6b"}
Jul 16 12:22:59.539245 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:22:59.539068    2580 scope.go:117] "RemoveContainer" containerID="07ad45ae46be24ac6d7000afd31013567b24bcedbcccb8eb9d63930d2f36ff6b"
Jul 16 12:23:00.551834 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:00.551738    2580 generic.go:356] "Generic (PLEG): container finished" podID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerID="59d1752b0d83417ce663688b07df2f3b8ad8db61d510b6ce9acd833c5158f39c" exitCode=7
Jul 16 12:23:00.551834 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:00.551821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq" event={"ID":"7485ae32-16f7-4453-ac9e-8ed9fc894792","Type":"ContainerDied","Data":"59d1752b0d83417ce663688b07df2f3b8ad8db61d510b6ce9acd833c5158f39c"}
Jul 16 12:23:00.552393 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:00.551901    2580 scope.go:117] "RemoveContainer" containerID="07ad45ae46be24ac6d7000afd31013567b24bcedbcccb8eb9d63930d2f36ff6b"
Jul 16 12:23:00.552393 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:00.552000    2580 scope.go:117] "RemoveContainer" containerID="59d1752b0d83417ce663688b07df2f3b8ad8db61d510b6ce9acd833c5158f39c"
Jul 16 12:23:00.552393 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:23:00.552202    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq_odh-ai-gateway-infra(7485ae32-16f7-4453-ac9e-8ed9fc894792)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792"
Jul 16 12:23:01.523122 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:01.523092    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:23:01.559847 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:01.559817    2580 scope.go:117] "RemoveContainer" containerID="59d1752b0d83417ce663688b07df2f3b8ad8db61d510b6ce9acd833c5158f39c"
Jul 16 12:23:01.560304 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:23:01.560048    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq_odh-ai-gateway-infra(7485ae32-16f7-4453-ac9e-8ed9fc894792)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792"
Jul 16 12:23:01.666666 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:01.666628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:14.394289 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:14.394260    2580 scope.go:117] "RemoveContainer" containerID="59d1752b0d83417ce663688b07df2f3b8ad8db61d510b6ce9acd833c5158f39c"
Jul 16 12:23:15.635567 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:15.635532    2580 generic.go:356] "Generic (PLEG): container finished" podID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerID="da81164a5d429b5e085b4c3766543b2b493341a9d094e2409bf7d36f9adf3b01" exitCode=0
Jul 16 12:23:15.636001 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:15.635601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq" event={"ID":"7485ae32-16f7-4453-ac9e-8ed9fc894792","Type":"ContainerDied","Data":"da81164a5d429b5e085b4c3766543b2b493341a9d094e2409bf7d36f9adf3b01"}
Jul 16 12:23:15.636001 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:15.635660    2580 scope.go:117] "RemoveContainer" containerID="59d1752b0d83417ce663688b07df2f3b8ad8db61d510b6ce9acd833c5158f39c"
Jul 16 12:23:16.668552 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:16.668520    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"]
Jul 16 12:23:16.781906 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:16.781879    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"
Jul 16 12:23:16.797644 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:16.797618    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7485ae32-16f7-4453-ac9e-8ed9fc894792-maas-api-service-ca\") pod \"7485ae32-16f7-4453-ac9e-8ed9fc894792\" (UID: \"7485ae32-16f7-4453-ac9e-8ed9fc894792\") "
Jul 16 12:23:16.797983 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:16.797955    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7485ae32-16f7-4453-ac9e-8ed9fc894792-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7485ae32-16f7-4453-ac9e-8ed9fc894792" (UID: "7485ae32-16f7-4453-ac9e-8ed9fc894792"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:16.898714 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:16.898623    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7485ae32-16f7-4453-ac9e-8ed9fc894792-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:23:17.648732 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:17.648704    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"
Jul 16 12:23:17.648732 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:17.648731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq" event={"ID":"7485ae32-16f7-4453-ac9e-8ed9fc894792","Type":"ContainerDied","Data":"564464cad10eabd7664b7c43140415f8f84c8a6bf714bc41b27ffd08ddba00be"}
Jul 16 12:23:17.648948 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:17.648774    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="564464cad10eabd7664b7c43140415f8f84c8a6bf714bc41b27ffd08ddba00be"
Jul 16 12:23:17.677687 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:17.677605    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"]
Jul 16 12:23:17.683468 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:17.683429    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-bl7vq"]
Jul 16 12:23:19.399154 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:19.399120    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792" path="/var/lib/kubelet/pods/7485ae32-16f7-4453-ac9e-8ed9fc894792/volumes"
Jul 16 12:23:47.931614 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:47.931582    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj"]
Jul 16 12:23:47.932111 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:47.931982    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerName="revoke-keys"
Jul 16 12:23:47.932111 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:47.931995    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerName="revoke-keys"
Jul 16 12:23:47.932111 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:47.932003    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerName="revoke-keys"
Jul 16 12:23:47.932111 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:47.932009    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerName="revoke-keys"
Jul 16 12:23:47.932111 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:47.932083    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerName="revoke-keys"
Jul 16 12:23:47.932111 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:47.932089    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerName="revoke-keys"
Jul 16 12:23:47.935106 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:47.935090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj"
Jul 16 12:23:47.937548 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:47.937524    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:23:47.944395 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:47.944370    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj"]
Jul 16 12:23:48.078125 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:48.078085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c89c4c-fc0f-4a21-8fdd-5209114a18e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj\" (UID: \"a4c89c4c-fc0f-4a21-8fdd-5209114a18e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj"
Jul 16 12:23:48.178957 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:48.178902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c89c4c-fc0f-4a21-8fdd-5209114a18e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj\" (UID: \"a4c89c4c-fc0f-4a21-8fdd-5209114a18e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj"
Jul 16 12:23:48.179536 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:48.179515    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c89c4c-fc0f-4a21-8fdd-5209114a18e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj\" (UID: \"a4c89c4c-fc0f-4a21-8fdd-5209114a18e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj"
Jul 16 12:23:48.246870 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:48.246785    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj"
Jul 16 12:23:48.388173 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:48.388144    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj"]
Jul 16 12:23:48.390361 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:23:48.390335    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c89c4c_fc0f_4a21_8fdd_5209114a18e7.slice/crio-665fd36545c97017272b1f150b36ac8b46a1211f4d601409365960e619eefb38 WatchSource:0}: Error finding container 665fd36545c97017272b1f150b36ac8b46a1211f4d601409365960e619eefb38: Status 404 returned error can't find the container with id 665fd36545c97017272b1f150b36ac8b46a1211f4d601409365960e619eefb38
Jul 16 12:23:48.816280 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:48.816244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj" event={"ID":"a4c89c4c-fc0f-4a21-8fdd-5209114a18e7","Type":"ContainerStarted","Data":"b9fbc3a34d7e9197403faef037bfd3ab04819f4319675cd958e5cd9b7cedc796"}
Jul 16 12:23:48.816450 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:48.816310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj" event={"ID":"a4c89c4c-fc0f-4a21-8fdd-5209114a18e7","Type":"ContainerStarted","Data":"665fd36545c97017272b1f150b36ac8b46a1211f4d601409365960e619eefb38"}
Jul 16 12:23:48.833708 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:48.833612    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj" podStartSLOduration=1.8335977940000001 podStartE2EDuration="1.833597794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:23:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:23:48.831681099 +0000 UTC m=+1993.946114376" watchObservedRunningTime="2026-07-16 12:23:48.833597794 +0000 UTC m=+1993.948031070"
Jul 16 12:23:49.822636 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:49.822597    2580 generic.go:356] "Generic (PLEG): container finished" podID="a4c89c4c-fc0f-4a21-8fdd-5209114a18e7" containerID="b9fbc3a34d7e9197403faef037bfd3ab04819f4319675cd958e5cd9b7cedc796" exitCode=0
Jul 16 12:23:49.823015 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:49.822687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj" event={"ID":"a4c89c4c-fc0f-4a21-8fdd-5209114a18e7","Type":"ContainerDied","Data":"b9fbc3a34d7e9197403faef037bfd3ab04819f4319675cd958e5cd9b7cedc796"}
Jul 16 12:23:50.962332 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:50.962308    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj"
Jul 16 12:23:51.108086 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:51.107987    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c89c4c-fc0f-4a21-8fdd-5209114a18e7-maas-api-service-ca\") pod \"a4c89c4c-fc0f-4a21-8fdd-5209114a18e7\" (UID: \"a4c89c4c-fc0f-4a21-8fdd-5209114a18e7\") "
Jul 16 12:23:51.108331 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:51.108308    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4c89c4c-fc0f-4a21-8fdd-5209114a18e7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4c89c4c-fc0f-4a21-8fdd-5209114a18e7" (UID: "a4c89c4c-fc0f-4a21-8fdd-5209114a18e7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:51.208943 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:51.208908    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4c89c4c-fc0f-4a21-8fdd-5209114a18e7-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:23:51.834096 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:51.834011    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj"
Jul 16 12:23:51.834096 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:51.834037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj" event={"ID":"a4c89c4c-fc0f-4a21-8fdd-5209114a18e7","Type":"ContainerDied","Data":"665fd36545c97017272b1f150b36ac8b46a1211f4d601409365960e619eefb38"}
Jul 16 12:23:51.834096 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:51.834087    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="665fd36545c97017272b1f150b36ac8b46a1211f4d601409365960e619eefb38"
Jul 16 12:23:58.561217 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.561181    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"]
Jul 16 12:23:58.561763 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.561434    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8" podUID="d1abb52e-42bb-466d-8610-88f93248d310" containerName="maas-api" containerID="cri-o://37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129" gracePeriod=30
Jul 16 12:23:58.604736 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.604696    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:23:58.819702 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.819637    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:23:58.871009 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.870976    2580 generic.go:356] "Generic (PLEG): container finished" podID="d1abb52e-42bb-466d-8610-88f93248d310" containerID="37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129" exitCode=0
Jul 16 12:23:58.871200 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.871023    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"
Jul 16 12:23:58.871200 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.871058    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8" event={"ID":"d1abb52e-42bb-466d-8610-88f93248d310","Type":"ContainerDied","Data":"37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129"}
Jul 16 12:23:58.871200 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.871109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8" event={"ID":"d1abb52e-42bb-466d-8610-88f93248d310","Type":"ContainerDied","Data":"640aae9afd2706c6f0dfb6b9e85fe431a5687d850f865ba56a28a24f6802aa80"}
Jul 16 12:23:58.871200 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.871134    2580 scope.go:117] "RemoveContainer" containerID="37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129"
Jul 16 12:23:58.877323 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.877299    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m8jt\" (UniqueName: \"kubernetes.io/projected/d1abb52e-42bb-466d-8610-88f93248d310-kube-api-access-6m8jt\") pod \"d1abb52e-42bb-466d-8610-88f93248d310\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") "
Jul 16 12:23:58.877444 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.877357    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1abb52e-42bb-466d-8610-88f93248d310-openshift-service-ca\") pod \"d1abb52e-42bb-466d-8610-88f93248d310\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") "
Jul 16 12:23:58.877444 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.877407    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1abb52e-42bb-466d-8610-88f93248d310-maas-api-tls\") pod \"d1abb52e-42bb-466d-8610-88f93248d310\" (UID: \"d1abb52e-42bb-466d-8610-88f93248d310\") "
Jul 16 12:23:58.877774 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.877751    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1abb52e-42bb-466d-8610-88f93248d310-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1abb52e-42bb-466d-8610-88f93248d310" (UID: "d1abb52e-42bb-466d-8610-88f93248d310"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:23:58.879506 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.879473    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1abb52e-42bb-466d-8610-88f93248d310-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1abb52e-42bb-466d-8610-88f93248d310" (UID: "d1abb52e-42bb-466d-8610-88f93248d310"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:23:58.879611 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.879500    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1abb52e-42bb-466d-8610-88f93248d310-kube-api-access-6m8jt" (OuterVolumeSpecName: "kube-api-access-6m8jt") pod "d1abb52e-42bb-466d-8610-88f93248d310" (UID: "d1abb52e-42bb-466d-8610-88f93248d310"). InnerVolumeSpecName "kube-api-access-6m8jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:23:58.880572 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.880553    2580 scope.go:117] "RemoveContainer" containerID="37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129"
Jul 16 12:23:58.880883 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:23:58.880859    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129\": container with ID starting with 37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129 not found: ID does not exist" containerID="37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129"
Jul 16 12:23:58.880948 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.880891    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129"} err="failed to get container status \"37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129\": rpc error: code = NotFound desc = could not find container \"37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129\": container with ID starting with 37fb43a370bb6019083c38554e2a0f68eebd9f8625bf864ec930e17286314129 not found: ID does not exist"
Jul 16 12:23:58.978642 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.978600    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m8jt\" (UniqueName: \"kubernetes.io/projected/d1abb52e-42bb-466d-8610-88f93248d310-kube-api-access-6m8jt\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:23:58.978642 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.978630    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1abb52e-42bb-466d-8610-88f93248d310-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:23:58.978642 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:58.978640    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1abb52e-42bb-466d-8610-88f93248d310-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:23:59.196107 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:59.196073    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"]
Jul 16 12:23:59.199148 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:59.199119    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26cae25e-55cc4957c4-7ftb8"]
Jul 16 12:23:59.400063 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:23:59.400024    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1abb52e-42bb-466d-8610-88f93248d310" path="/var/lib/kubelet/pods/d1abb52e-42bb-466d-8610-88f93248d310/volumes"
Jul 16 12:24:03.029477 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:03.029424    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:09.351326 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:09.351284    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:09.430427 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:09.430388    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:13.246760 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:13.246727    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:13.896680 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:13.896641    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:13.991579 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:13.991542    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:14.091231 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:14.091194    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:17.429388 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:17.429349    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:19.817940 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:19.817912    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:21.439599 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:21.439562    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:21.615305 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:21.615271    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:21.782959 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:21.782869    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:21.962376 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:21.962339    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:22.069495 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:22.069396    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:22.440695 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:22.440663    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:41.059866 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:41.059805    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:48.439651 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:48.439591    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:54.555296 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:54.555256    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:54.669979 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:54.669946    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:24:54.795515 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:24:54.795475    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:10.787974 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:10.787891    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:17.431305 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:17.431259    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:17.546482 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:17.546420    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:17.632398 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:17.632369    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:28.196390 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:28.196354    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:29.043656 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:29.043618    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:35.264651 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:35.264611    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:35.368566 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:35.368531    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:35.467363 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:35.467328    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:35.513091 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:35.513064    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:25:35.515272 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:35.515195    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:25:35.516411 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:35.516386    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:25:35.518760 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:35.518737    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:25:35.567431 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:35.567402    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:35.589620 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:35.589596    2580 scope.go:117] "RemoveContainer" containerID="d18ab65789545605c276d5ac164e25817d6c762ec996ac658e28a68c9ecefcfc"
Jul 16 12:25:36.427036 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:36.426993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:36.548654 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:36.548615    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:38.298742 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:38.298707    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:44.562141 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:44.562104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:44.662584 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:44.662527    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:45.268200 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:45.268142    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:51.209109 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:51.209052    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:51.312088 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:51.312051    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:51.470336 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:51.470241    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:51.804121 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:51.804014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:52.084586 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:52.084451    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:54.840750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.840710    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:54.944167 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.944133    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:54.990722 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.990686    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"]
Jul 16 12:25:54.991188 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.991158    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1abb52e-42bb-466d-8610-88f93248d310" containerName="maas-api"
Jul 16 12:25:54.991188 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.991182    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1abb52e-42bb-466d-8610-88f93248d310" containerName="maas-api"
Jul 16 12:25:54.991357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.991199    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c89c4c-fc0f-4a21-8fdd-5209114a18e7" containerName="revoke-keys"
Jul 16 12:25:54.991357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.991204    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c89c4c-fc0f-4a21-8fdd-5209114a18e7" containerName="revoke-keys"
Jul 16 12:25:54.991357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.991213    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerName="revoke-keys"
Jul 16 12:25:54.991357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.991218    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerName="revoke-keys"
Jul 16 12:25:54.991357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.991279    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1abb52e-42bb-466d-8610-88f93248d310" containerName="maas-api"
Jul 16 12:25:54.991357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.991290    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7485ae32-16f7-4453-ac9e-8ed9fc894792" containerName="revoke-keys"
Jul 16 12:25:54.991357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.991296    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c89c4c-fc0f-4a21-8fdd-5209114a18e7" containerName="revoke-keys"
Jul 16 12:25:54.994563 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.994546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:54.997620 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:54.997586    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1b4f12d1-serving-cert\""
Jul 16 12:25:55.005830 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.005805    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"]
Jul 16 12:25:55.080624 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.080582    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:55.152004 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.151971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51ce1139-b497-4414-840e-9d46c14ee464-openshift-service-ca\") pod \"maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:55.152184 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.152029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51ce1139-b497-4414-840e-9d46c14ee464-maas-api-tls\") pod \"maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:55.152184 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.152054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84fwm\" (UniqueName: \"kubernetes.io/projected/51ce1139-b497-4414-840e-9d46c14ee464-kube-api-access-84fwm\") pod \"maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:55.196236 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.196190    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:55.253433 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.253399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51ce1139-b497-4414-840e-9d46c14ee464-openshift-service-ca\") pod \"maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:55.253627 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.253447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51ce1139-b497-4414-840e-9d46c14ee464-maas-api-tls\") pod \"maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:55.253627 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.253502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84fwm\" (UniqueName: \"kubernetes.io/projected/51ce1139-b497-4414-840e-9d46c14ee464-kube-api-access-84fwm\") pod \"maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:55.254056 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.254030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51ce1139-b497-4414-840e-9d46c14ee464-openshift-service-ca\") pod \"maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:55.256093 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.256061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51ce1139-b497-4414-840e-9d46c14ee464-maas-api-tls\") pod \"maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:55.263721 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.263696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84fwm\" (UniqueName: \"kubernetes.io/projected/51ce1139-b497-4414-840e-9d46c14ee464-kube-api-access-84fwm\") pod \"maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:55.305384 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.305345    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:55.472840 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.472803    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"]
Jul 16 12:25:55.474737 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:25:55.474711    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ce1139_b497_4414_840e_9d46c14ee464.slice/crio-931163bf082148dae09815e46ab2bc105bb328bbedd385a0a000332562930788 WatchSource:0}: Error finding container 931163bf082148dae09815e46ab2bc105bb328bbedd385a0a000332562930788: Status 404 returned error can't find the container with id 931163bf082148dae09815e46ab2bc105bb328bbedd385a0a000332562930788
Jul 16 12:25:55.476236 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.476219    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:25:55.693063 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:55.692998    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:56.488007 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:56.487969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4" event={"ID":"51ce1139-b497-4414-840e-9d46c14ee464","Type":"ContainerStarted","Data":"719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96"}
Jul 16 12:25:56.488427 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:56.488042    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4" event={"ID":"51ce1139-b497-4414-840e-9d46c14ee464","Type":"ContainerStarted","Data":"931163bf082148dae09815e46ab2bc105bb328bbedd385a0a000332562930788"}
Jul 16 12:25:56.488427 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:56.488082    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:25:57.346579 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:57.346542    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:25:59.360633 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:25:59.360598    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:02.111080 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:02.110995    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:02.177026 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:02.176987    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:02.499483 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:02.499431    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:26:02.516395 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:02.516326    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4" podStartSLOduration=7.950486858 podStartE2EDuration="8.516309349s" totalImagesPullingTime="565.822491ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:25:56.5102382 +0000 UTC m=+2121.624671476" watchObservedRunningTime="2026-07-16 12:26:02.516309349 +0000 UTC m=+2127.630742624"
Jul 16 12:26:04.168586 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:04.168546    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:04.267857 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:04.267824    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:06.873905 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:06.873866    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:06.982307 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:06.982271    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:07.346394 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:07.346355    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg"]
Jul 16 12:26:07.350222 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:07.350200    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg"
Jul 16 12:26:07.352750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:07.352725    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:26:07.358519 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:07.358181    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg"]
Jul 16 12:26:07.363665 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:07.363640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b1c5b9-6312-463d-8adf-60960cfa1a75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg\" (UID: \"f7b1c5b9-6312-463d-8adf-60960cfa1a75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg"
Jul 16 12:26:07.464711 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:07.464543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b1c5b9-6312-463d-8adf-60960cfa1a75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg\" (UID: \"f7b1c5b9-6312-463d-8adf-60960cfa1a75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg"
Jul 16 12:26:07.465328 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:07.465299    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b1c5b9-6312-463d-8adf-60960cfa1a75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg\" (UID: \"f7b1c5b9-6312-463d-8adf-60960cfa1a75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg"
Jul 16 12:26:07.662822 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:07.662783    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg"
Jul 16 12:26:07.800645 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:07.800613    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg"]
Jul 16 12:26:07.801643 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:26:07.801618    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b1c5b9_6312_463d_8adf_60960cfa1a75.slice/crio-a2e1562f22ac9e7b90c0f6ffede9002f86e3f9f180e6684c11c65548ad0440f2 WatchSource:0}: Error finding container a2e1562f22ac9e7b90c0f6ffede9002f86e3f9f180e6684c11c65548ad0440f2: Status 404 returned error can't find the container with id a2e1562f22ac9e7b90c0f6ffede9002f86e3f9f180e6684c11c65548ad0440f2
Jul 16 12:26:08.023396 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:08.023366    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:08.134558 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:08.134525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:08.559185 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:08.559148    2580 generic.go:356] "Generic (PLEG): container finished" podID="f7b1c5b9-6312-463d-8adf-60960cfa1a75" containerID="95e332da74a00d708b1cd0a1b21cee8603183137da8a96132611f40f9074a22e" exitCode=0
Jul 16 12:26:08.559357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:08.559234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg" event={"ID":"f7b1c5b9-6312-463d-8adf-60960cfa1a75","Type":"ContainerDied","Data":"95e332da74a00d708b1cd0a1b21cee8603183137da8a96132611f40f9074a22e"}
Jul 16 12:26:08.559357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:08.559319    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg" event={"ID":"f7b1c5b9-6312-463d-8adf-60960cfa1a75","Type":"ContainerStarted","Data":"a2e1562f22ac9e7b90c0f6ffede9002f86e3f9f180e6684c11c65548ad0440f2"}
Jul 16 12:26:09.701844 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:09.701818    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg"
Jul 16 12:26:09.787391 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:09.787357    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b1c5b9-6312-463d-8adf-60960cfa1a75-maas-api-service-ca\") pod \"f7b1c5b9-6312-463d-8adf-60960cfa1a75\" (UID: \"f7b1c5b9-6312-463d-8adf-60960cfa1a75\") "
Jul 16 12:26:09.787749 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:09.787727    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7b1c5b9-6312-463d-8adf-60960cfa1a75-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f7b1c5b9-6312-463d-8adf-60960cfa1a75" (UID: "f7b1c5b9-6312-463d-8adf-60960cfa1a75"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:26:09.888642 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:09.888616    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7b1c5b9-6312-463d-8adf-60960cfa1a75-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:26:10.571026 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:10.570987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg" event={"ID":"f7b1c5b9-6312-463d-8adf-60960cfa1a75","Type":"ContainerDied","Data":"a2e1562f22ac9e7b90c0f6ffede9002f86e3f9f180e6684c11c65548ad0440f2"}
Jul 16 12:26:10.571206 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:10.571045    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2e1562f22ac9e7b90c0f6ffede9002f86e3f9f180e6684c11c65548ad0440f2"
Jul 16 12:26:10.571206 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:10.570999    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg"
Jul 16 12:26:17.897629 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:17.897597    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"]
Jul 16 12:26:17.898089 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:17.897802    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4" podUID="51ce1139-b497-4414-840e-9d46c14ee464" containerName="maas-api" containerID="cri-o://719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96" gracePeriod=30
Jul 16 12:26:17.934594 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:17.934567    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:18.148134 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.148069    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:26:18.264143 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.264109    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51ce1139-b497-4414-840e-9d46c14ee464-openshift-service-ca\") pod \"51ce1139-b497-4414-840e-9d46c14ee464\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") "
Jul 16 12:26:18.264303 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.264213    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51ce1139-b497-4414-840e-9d46c14ee464-maas-api-tls\") pod \"51ce1139-b497-4414-840e-9d46c14ee464\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") "
Jul 16 12:26:18.264303 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.264269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84fwm\" (UniqueName: \"kubernetes.io/projected/51ce1139-b497-4414-840e-9d46c14ee464-kube-api-access-84fwm\") pod \"51ce1139-b497-4414-840e-9d46c14ee464\" (UID: \"51ce1139-b497-4414-840e-9d46c14ee464\") "
Jul 16 12:26:18.264544 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.264518    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ce1139-b497-4414-840e-9d46c14ee464-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "51ce1139-b497-4414-840e-9d46c14ee464" (UID: "51ce1139-b497-4414-840e-9d46c14ee464"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:26:18.266472 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.266441    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ce1139-b497-4414-840e-9d46c14ee464-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "51ce1139-b497-4414-840e-9d46c14ee464" (UID: "51ce1139-b497-4414-840e-9d46c14ee464"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:26:18.266580 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.266546    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ce1139-b497-4414-840e-9d46c14ee464-kube-api-access-84fwm" (OuterVolumeSpecName: "kube-api-access-84fwm") pod "51ce1139-b497-4414-840e-9d46c14ee464" (UID: "51ce1139-b497-4414-840e-9d46c14ee464"). InnerVolumeSpecName "kube-api-access-84fwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:26:18.365289 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.365248    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84fwm\" (UniqueName: \"kubernetes.io/projected/51ce1139-b497-4414-840e-9d46c14ee464-kube-api-access-84fwm\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:26:18.365289 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.365282    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51ce1139-b497-4414-840e-9d46c14ee464-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:26:18.365289 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.365291    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51ce1139-b497-4414-840e-9d46c14ee464-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:26:18.617138 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.617053    2580 generic.go:356] "Generic (PLEG): container finished" podID="51ce1139-b497-4414-840e-9d46c14ee464" containerID="719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96" exitCode=0
Jul 16 12:26:18.617138 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.617091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4" event={"ID":"51ce1139-b497-4414-840e-9d46c14ee464","Type":"ContainerDied","Data":"719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96"}
Jul 16 12:26:18.617138 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.617101    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"
Jul 16 12:26:18.617428 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.617144    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4" event={"ID":"51ce1139-b497-4414-840e-9d46c14ee464","Type":"ContainerDied","Data":"931163bf082148dae09815e46ab2bc105bb328bbedd385a0a000332562930788"}
Jul 16 12:26:18.617428 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.617167    2580 scope.go:117] "RemoveContainer" containerID="719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96"
Jul 16 12:26:18.626254 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.626238    2580 scope.go:117] "RemoveContainer" containerID="719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96"
Jul 16 12:26:18.626511 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:26:18.626490    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96\": container with ID starting with 719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96 not found: ID does not exist" containerID="719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96"
Jul 16 12:26:18.626583 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.626523    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96"} err="failed to get container status \"719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96\": rpc error: code = NotFound desc = could not find container \"719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96\": container with ID starting with 719dc483e7c3efde2f2100daa1bdd1f929e2e07f5cce012beac441e7674bbe96 not found: ID does not exist"
Jul 16 12:26:18.638856 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.638835    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"]
Jul 16 12:26:18.644739 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:18.644719    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1b4f12d1-56cc648776-ddrg4"]
Jul 16 12:26:19.400058 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:19.400021    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51ce1139-b497-4414-840e-9d46c14ee464" path="/var/lib/kubelet/pods/51ce1139-b497-4414-840e-9d46c14ee464/volumes"
Jul 16 12:26:22.436803 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:22.436767    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:29.100197 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:29.100111    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:29.196805 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:29.196773    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:29.518803 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:29.518763    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:33.220235 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:33.220188    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:33.453088 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:33.453052    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:33.646540 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:33.646504    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:33.756225 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:33.756190    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:33.861483 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:33.861435    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:35.610624 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:35.610589    2580 scope.go:117] "RemoveContainer" containerID="bdb02c98858c90dfe687edd3c28e9519a9c36c3931ee86239cbd09bc0ab16c65"
Jul 16 12:26:40.739982 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:40.739950    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:40.914264 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:40.914231    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:41.046234 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:41.046143    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:41.185240 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:41.185205    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:41.467716 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:41.467682    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:41.632272 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:41.632240    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:47.372737 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:47.372703    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:47.474662 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:47.474632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:54.401862 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:54.401826    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:54.747882 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:54.747807    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:55.326776 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:55.326745    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:58.173353 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.173289    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:58.510700 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.510611    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"]
Jul 16 12:26:58.511126 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.511106    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ce1139-b497-4414-840e-9d46c14ee464" containerName="maas-api"
Jul 16 12:26:58.511224 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.511128    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ce1139-b497-4414-840e-9d46c14ee464" containerName="maas-api"
Jul 16 12:26:58.511224 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.511140    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b1c5b9-6312-463d-8adf-60960cfa1a75" containerName="revoke-keys"
Jul 16 12:26:58.511224 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.511147    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b1c5b9-6312-463d-8adf-60960cfa1a75" containerName="revoke-keys"
Jul 16 12:26:58.511375 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.511246    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ce1139-b497-4414-840e-9d46c14ee464" containerName="maas-api"
Jul 16 12:26:58.511375 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.511265    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7b1c5b9-6312-463d-8adf-60960cfa1a75" containerName="revoke-keys"
Jul 16 12:26:58.515731 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.515709    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:58.522739 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.522395    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-4a07820d-serving-cert\""
Jul 16 12:26:58.533368 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.533347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955fcc52-c6c1-4e04-bb9c-071be734be82-openshift-service-ca\") pod \"maas-api-e2e-mt-4a07820d-5c55645c69-djb2r\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:58.533469 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.533412    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4kxd\" (UniqueName: \"kubernetes.io/projected/955fcc52-c6c1-4e04-bb9c-071be734be82-kube-api-access-s4kxd\") pod \"maas-api-e2e-mt-4a07820d-5c55645c69-djb2r\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:58.533469 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.533448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955fcc52-c6c1-4e04-bb9c-071be734be82-maas-api-tls\") pod \"maas-api-e2e-mt-4a07820d-5c55645c69-djb2r\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:58.556184 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.556157    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"]
Jul 16 12:26:58.634067 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.634022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955fcc52-c6c1-4e04-bb9c-071be734be82-maas-api-tls\") pod \"maas-api-e2e-mt-4a07820d-5c55645c69-djb2r\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:58.634270 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.634103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955fcc52-c6c1-4e04-bb9c-071be734be82-openshift-service-ca\") pod \"maas-api-e2e-mt-4a07820d-5c55645c69-djb2r\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:58.634270 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:26:58.634168    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-serving-cert: secret "maas-api-e2e-mt-4a07820d-serving-cert" not found
Jul 16 12:26:58.634270 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:26:58.634232    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/955fcc52-c6c1-4e04-bb9c-071be734be82-maas-api-tls podName:955fcc52-c6c1-4e04-bb9c-071be734be82 nodeName:}" failed. No retries permitted until 2026-07-16 12:26:59.134214293 +0000 UTC m=+2184.248647546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/955fcc52-c6c1-4e04-bb9c-071be734be82-maas-api-tls") pod "maas-api-e2e-mt-4a07820d-5c55645c69-djb2r" (UID: "955fcc52-c6c1-4e04-bb9c-071be734be82") : secret "maas-api-e2e-mt-4a07820d-serving-cert" not found
Jul 16 12:26:58.634270 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.634245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4kxd\" (UniqueName: \"kubernetes.io/projected/955fcc52-c6c1-4e04-bb9c-071be734be82-kube-api-access-s4kxd\") pod \"maas-api-e2e-mt-4a07820d-5c55645c69-djb2r\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:58.635023 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.634991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955fcc52-c6c1-4e04-bb9c-071be734be82-openshift-service-ca\") pod \"maas-api-e2e-mt-4a07820d-5c55645c69-djb2r\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:58.653036 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:58.653008    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4kxd\" (UniqueName: \"kubernetes.io/projected/955fcc52-c6c1-4e04-bb9c-071be734be82-kube-api-access-s4kxd\") pod \"maas-api-e2e-mt-4a07820d-5c55645c69-djb2r\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:59.139518 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:59.139481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955fcc52-c6c1-4e04-bb9c-071be734be82-maas-api-tls\") pod \"maas-api-e2e-mt-4a07820d-5c55645c69-djb2r\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:59.142098 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:59.142058    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955fcc52-c6c1-4e04-bb9c-071be734be82-maas-api-tls\") pod \"maas-api-e2e-mt-4a07820d-5c55645c69-djb2r\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:59.355024 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:59.354993    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:59.425767 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:59.425688    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:26:59.471311 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:59.471270    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:26:59.572991 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:59.572964    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"]
Jul 16 12:26:59.575356 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:26:59.575323    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod955fcc52_c6c1_4e04_bb9c_071be734be82.slice/crio-d93bfb44d9191e5e2c7cbf7fba9cb48a82587345353623ec1c8bff180e712170 WatchSource:0}: Error finding container d93bfb44d9191e5e2c7cbf7fba9cb48a82587345353623ec1c8bff180e712170: Status 404 returned error can't find the container with id d93bfb44d9191e5e2c7cbf7fba9cb48a82587345353623ec1c8bff180e712170
Jul 16 12:26:59.832820 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:26:59.832740    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r" event={"ID":"955fcc52-c6c1-4e04-bb9c-071be734be82","Type":"ContainerStarted","Data":"d93bfb44d9191e5e2c7cbf7fba9cb48a82587345353623ec1c8bff180e712170"}
Jul 16 12:27:00.839003 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:00.838971    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r" event={"ID":"955fcc52-c6c1-4e04-bb9c-071be734be82","Type":"ContainerStarted","Data":"91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f"}
Jul 16 12:27:00.839396 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:00.839098    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:27:00.867059 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:00.867001    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r" podStartSLOduration=2.202431023 podStartE2EDuration="2.866985772s" totalImagesPullingTime="664.554749ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:00.866241323 +0000 UTC m=+2185.980674613" watchObservedRunningTime="2026-07-16 12:27:00.866985772 +0000 UTC m=+2185.981419048"
Jul 16 12:27:02.784123 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:02.784073    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:06.848965 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:06.848933    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:27:15.637518 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:15.637482    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:36.118164 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:36.118120    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv"]
Jul 16 12:27:36.121935 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:36.121917    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv"
Jul 16 12:27:36.124485 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:36.124446    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:27:36.130084 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:36.129571    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv"]
Jul 16 12:27:36.195521 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:36.195454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad9febf-f792-419d-8511-434e0b0764fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv\" (UID: \"7ad9febf-f792-419d-8511-434e0b0764fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv"
Jul 16 12:27:36.296178 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:36.296137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad9febf-f792-419d-8511-434e0b0764fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv\" (UID: \"7ad9febf-f792-419d-8511-434e0b0764fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv"
Jul 16 12:27:36.296799 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:36.296779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad9febf-f792-419d-8511-434e0b0764fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv\" (UID: \"7ad9febf-f792-419d-8511-434e0b0764fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv"
Jul 16 12:27:36.435168 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:36.435131    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv"
Jul 16 12:27:36.574768 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:36.574749    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv"]
Jul 16 12:27:36.577391 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:27:36.577354    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad9febf_f792_419d_8511_434e0b0764fa.slice/crio-f6d0e3486d0c71daa5184e42fba23cb9f89bf6ea29b1ded1647016ce3e2782d0 WatchSource:0}: Error finding container f6d0e3486d0c71daa5184e42fba23cb9f89bf6ea29b1ded1647016ce3e2782d0: Status 404 returned error can't find the container with id f6d0e3486d0c71daa5184e42fba23cb9f89bf6ea29b1ded1647016ce3e2782d0
Jul 16 12:27:37.025538 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:37.025502    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv" event={"ID":"7ad9febf-f792-419d-8511-434e0b0764fa","Type":"ContainerStarted","Data":"c66966abc87741a36d98b8c72aff8ff301490508903c42f1bb98aff19b87d67d"}
Jul 16 12:27:37.025713 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:37.025556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv" event={"ID":"7ad9febf-f792-419d-8511-434e0b0764fa","Type":"ContainerStarted","Data":"f6d0e3486d0c71daa5184e42fba23cb9f89bf6ea29b1ded1647016ce3e2782d0"}
Jul 16 12:27:37.045180 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:37.045076    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv" podStartSLOduration=1.045055808 podStartE2EDuration="1.045055808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:27:37.043093271 +0000 UTC m=+2222.157526552" watchObservedRunningTime="2026-07-16 12:27:37.045055808 +0000 UTC m=+2222.159489084"
Jul 16 12:27:38.032531 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:38.032498    2580 generic.go:356] "Generic (PLEG): container finished" podID="7ad9febf-f792-419d-8511-434e0b0764fa" containerID="c66966abc87741a36d98b8c72aff8ff301490508903c42f1bb98aff19b87d67d" exitCode=0
Jul 16 12:27:38.032910 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:38.032568    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv" event={"ID":"7ad9febf-f792-419d-8511-434e0b0764fa","Type":"ContainerDied","Data":"c66966abc87741a36d98b8c72aff8ff301490508903c42f1bb98aff19b87d67d"}
Jul 16 12:27:39.172402 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:39.172378    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv"
Jul 16 12:27:39.222133 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:39.222100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad9febf-f792-419d-8511-434e0b0764fa-maas-api-service-ca\") pod \"7ad9febf-f792-419d-8511-434e0b0764fa\" (UID: \"7ad9febf-f792-419d-8511-434e0b0764fa\") "
Jul 16 12:27:39.222509 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:39.222453    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ad9febf-f792-419d-8511-434e0b0764fa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ad9febf-f792-419d-8511-434e0b0764fa" (UID: "7ad9febf-f792-419d-8511-434e0b0764fa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:27:39.323792 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:39.323700    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ad9febf-f792-419d-8511-434e0b0764fa-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:27:40.044751 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:40.044709    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv" event={"ID":"7ad9febf-f792-419d-8511-434e0b0764fa","Type":"ContainerDied","Data":"f6d0e3486d0c71daa5184e42fba23cb9f89bf6ea29b1ded1647016ce3e2782d0"}
Jul 16 12:27:40.044930 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:40.044765    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6d0e3486d0c71daa5184e42fba23cb9f89bf6ea29b1ded1647016ce3e2782d0"
Jul 16 12:27:40.044930 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:40.044725    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv"
Jul 16 12:27:46.730790 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:46.730757    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"]
Jul 16 12:27:46.731309 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:46.730979    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r" podUID="955fcc52-c6c1-4e04-bb9c-071be734be82" containerName="maas-api" containerID="cri-o://91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f" gracePeriod=30
Jul 16 12:27:46.763337 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:46.763305    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:46.844277 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:46.844236    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r" podUID="955fcc52-c6c1-4e04-bb9c-071be734be82" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.51:8443/health\": dial tcp 10.132.0.51:8443: connect: connection refused"
Jul 16 12:27:46.980775 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:46.980750    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:27:47.086449 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.086360    2580 generic.go:356] "Generic (PLEG): container finished" podID="955fcc52-c6c1-4e04-bb9c-071be734be82" containerID="91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f" exitCode=0
Jul 16 12:27:47.086449 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.086417    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"
Jul 16 12:27:47.086646 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.086446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r" event={"ID":"955fcc52-c6c1-4e04-bb9c-071be734be82","Type":"ContainerDied","Data":"91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f"}
Jul 16 12:27:47.086646 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.086522    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r" event={"ID":"955fcc52-c6c1-4e04-bb9c-071be734be82","Type":"ContainerDied","Data":"d93bfb44d9191e5e2c7cbf7fba9cb48a82587345353623ec1c8bff180e712170"}
Jul 16 12:27:47.086646 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.086551    2580 scope.go:117] "RemoveContainer" containerID="91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f"
Jul 16 12:27:47.095703 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.095683    2580 scope.go:117] "RemoveContainer" containerID="91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f"
Jul 16 12:27:47.095980 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:27:47.095961    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f\": container with ID starting with 91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f not found: ID does not exist" containerID="91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f"
Jul 16 12:27:47.096028 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.095990    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f"} err="failed to get container status \"91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f\": rpc error: code = NotFound desc = could not find container \"91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f\": container with ID starting with 91baf97e9a1f28ca36d10d8d297489deca303dc69a93543534678b00a238c52f not found: ID does not exist"
Jul 16 12:27:47.097201 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.097186    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4kxd\" (UniqueName: \"kubernetes.io/projected/955fcc52-c6c1-4e04-bb9c-071be734be82-kube-api-access-s4kxd\") pod \"955fcc52-c6c1-4e04-bb9c-071be734be82\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") "
Jul 16 12:27:47.097253 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.097214    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955fcc52-c6c1-4e04-bb9c-071be734be82-maas-api-tls\") pod \"955fcc52-c6c1-4e04-bb9c-071be734be82\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") "
Jul 16 12:27:47.097323 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.097310    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955fcc52-c6c1-4e04-bb9c-071be734be82-openshift-service-ca\") pod \"955fcc52-c6c1-4e04-bb9c-071be734be82\" (UID: \"955fcc52-c6c1-4e04-bb9c-071be734be82\") "
Jul 16 12:27:47.097692 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.097672    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/955fcc52-c6c1-4e04-bb9c-071be734be82-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "955fcc52-c6c1-4e04-bb9c-071be734be82" (UID: "955fcc52-c6c1-4e04-bb9c-071be734be82"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:27:47.099199 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.099175    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/955fcc52-c6c1-4e04-bb9c-071be734be82-kube-api-access-s4kxd" (OuterVolumeSpecName: "kube-api-access-s4kxd") pod "955fcc52-c6c1-4e04-bb9c-071be734be82" (UID: "955fcc52-c6c1-4e04-bb9c-071be734be82"). InnerVolumeSpecName "kube-api-access-s4kxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:27:47.099334 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.099321    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/955fcc52-c6c1-4e04-bb9c-071be734be82-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "955fcc52-c6c1-4e04-bb9c-071be734be82" (UID: "955fcc52-c6c1-4e04-bb9c-071be734be82"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:27:47.198668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.198636    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/955fcc52-c6c1-4e04-bb9c-071be734be82-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:27:47.198668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.198665    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4kxd\" (UniqueName: \"kubernetes.io/projected/955fcc52-c6c1-4e04-bb9c-071be734be82-kube-api-access-s4kxd\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:27:47.198668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.198675    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/955fcc52-c6c1-4e04-bb9c-071be734be82-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:27:47.431872 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.431839    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"]
Jul 16 12:27:47.444240 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:47.444211    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4a07820d-5c55645c69-djb2r"]
Jul 16 12:27:49.399827 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:49.399786    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="955fcc52-c6c1-4e04-bb9c-071be734be82" path="/var/lib/kubelet/pods/955fcc52-c6c1-4e04-bb9c-071be734be82/volumes"
Jul 16 12:27:51.241876 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:51.241836    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:27:56.304514 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:27:56.304479    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:31.240449 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:31.240412    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:33.238640 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:33.238608    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:33.967329 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:33.967293    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:35.642468 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:35.642420    2580 scope.go:117] "RemoveContainer" containerID="49cc147b23082af0801a4b280d7d9642be59b60778672be1338608354ad6a77f"
Jul 16 12:28:40.214154 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:40.214116    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:40.323527 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:40.323484    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:43.669209 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:43.669176    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:43.919731 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:43.919647    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:45.042323 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:45.042285    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:45.141367 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:45.141326    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:46.084937 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:46.084901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:46.342875 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:46.342793    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:47.793981 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:47.793938    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:55.057708 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:55.057670    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:55.242077 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:55.242046    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:28:55.836873 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:28:55.836832    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:02.546874 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:02.546838    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:02.660836 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:02.660807    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:13.098000 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:13.097967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:13.502521 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:13.502490    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:34.510192 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:34.510112    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:35.665235 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:35.665202    2580 scope.go:117] "RemoveContainer" containerID="da81164a5d429b5e085b4c3766543b2b493341a9d094e2409bf7d36f9adf3b01"
Jul 16 12:29:41.086719 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:41.086684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:41.169103 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:41.169070    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:41.472305 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:41.472278    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:41.927360 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:41.927312    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:42.134142 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:42.134099    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:45.078516 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.078480    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:45.183643 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.183607    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:45.222097 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.222066    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"]
Jul 16 12:29:45.222529 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.222511    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="955fcc52-c6c1-4e04-bb9c-071be734be82" containerName="maas-api"
Jul 16 12:29:45.222529 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.222530    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="955fcc52-c6c1-4e04-bb9c-071be734be82" containerName="maas-api"
Jul 16 12:29:45.222633 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.222542    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ad9febf-f792-419d-8511-434e0b0764fa" containerName="revoke-keys"
Jul 16 12:29:45.222633 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.222547    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ad9febf-f792-419d-8511-434e0b0764fa" containerName="revoke-keys"
Jul 16 12:29:45.222633 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.222605    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="955fcc52-c6c1-4e04-bb9c-071be734be82" containerName="maas-api"
Jul 16 12:29:45.222633 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.222617    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ad9febf-f792-419d-8511-434e0b0764fa" containerName="revoke-keys"
Jul 16 12:29:45.225963 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.225944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:45.230274 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.230258    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e86929-serving-cert\""
Jul 16 12:29:45.243235 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.243197    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"]
Jul 16 12:29:45.328026 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.327988    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:45.358188 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.358100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24dbb1cc-c837-42e3-bfce-c5361b8874f7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e86929-5f74494774-s2999\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:45.358188 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.358145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24dbb1cc-c837-42e3-bfce-c5361b8874f7-maas-api-tls\") pod \"maas-api-e2e-inf-a-e86929-5f74494774-s2999\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:45.358188 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.358177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztd6n\" (UniqueName: \"kubernetes.io/projected/24dbb1cc-c837-42e3-bfce-c5361b8874f7-kube-api-access-ztd6n\") pod \"maas-api-e2e-inf-a-e86929-5f74494774-s2999\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:45.459702 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.459659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztd6n\" (UniqueName: \"kubernetes.io/projected/24dbb1cc-c837-42e3-bfce-c5361b8874f7-kube-api-access-ztd6n\") pod \"maas-api-e2e-inf-a-e86929-5f74494774-s2999\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:45.459898 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.459768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24dbb1cc-c837-42e3-bfce-c5361b8874f7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e86929-5f74494774-s2999\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:45.459898 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.459790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24dbb1cc-c837-42e3-bfce-c5361b8874f7-maas-api-tls\") pod \"maas-api-e2e-inf-a-e86929-5f74494774-s2999\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:45.459991 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:29:45.459908    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-serving-cert: secret "maas-api-e2e-inf-a-e86929-serving-cert" not found
Jul 16 12:29:45.459991 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:29:45.459973    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24dbb1cc-c837-42e3-bfce-c5361b8874f7-maas-api-tls podName:24dbb1cc-c837-42e3-bfce-c5361b8874f7 nodeName:}" failed. No retries permitted until 2026-07-16 12:29:45.959956111 +0000 UTC m=+2351.074389366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/24dbb1cc-c837-42e3-bfce-c5361b8874f7-maas-api-tls") pod "maas-api-e2e-inf-a-e86929-5f74494774-s2999" (UID: "24dbb1cc-c837-42e3-bfce-c5361b8874f7") : secret "maas-api-e2e-inf-a-e86929-serving-cert" not found
Jul 16 12:29:45.460395 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.460372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24dbb1cc-c837-42e3-bfce-c5361b8874f7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e86929-5f74494774-s2999\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:45.473159 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.473124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztd6n\" (UniqueName: \"kubernetes.io/projected/24dbb1cc-c837-42e3-bfce-c5361b8874f7-kube-api-access-ztd6n\") pod \"maas-api-e2e-inf-a-e86929-5f74494774-s2999\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:45.628947 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.628871    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:45.964684 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.964646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24dbb1cc-c837-42e3-bfce-c5361b8874f7-maas-api-tls\") pod \"maas-api-e2e-inf-a-e86929-5f74494774-s2999\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:45.967125 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:45.967103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24dbb1cc-c837-42e3-bfce-c5361b8874f7-maas-api-tls\") pod \"maas-api-e2e-inf-a-e86929-5f74494774-s2999\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:46.136128 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:46.136097    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:46.303980 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:46.303954    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"]
Jul 16 12:29:46.305792 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:29:46.305766    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24dbb1cc_c837_42e3_bfce_c5361b8874f7.slice/crio-d0557159829e030af67d4eecde883509878fe1a9f90c2298c2c17d604ad19be9 WatchSource:0}: Error finding container d0557159829e030af67d4eecde883509878fe1a9f90c2298c2c17d604ad19be9: Status 404 returned error can't find the container with id d0557159829e030af67d4eecde883509878fe1a9f90c2298c2c17d604ad19be9
Jul 16 12:29:46.393181 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:46.393147    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:46.668514 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:46.668478    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:46.700743 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:46.700709    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999" event={"ID":"24dbb1cc-c837-42e3-bfce-c5361b8874f7","Type":"ContainerStarted","Data":"d0557159829e030af67d4eecde883509878fe1a9f90c2298c2c17d604ad19be9"}
Jul 16 12:29:47.707206 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:47.707165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999" event={"ID":"24dbb1cc-c837-42e3-bfce-c5361b8874f7","Type":"ContainerStarted","Data":"70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d"}
Jul 16 12:29:47.707707 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:47.707285    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:47.736596 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:47.736536    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999" podStartSLOduration=2.307886974 podStartE2EDuration="2.736518301s" totalImagesPullingTime="428.631327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:29:47.734542902 +0000 UTC m=+2352.848976177" watchObservedRunningTime="2026-07-16 12:29:47.736518301 +0000 UTC m=+2352.850951576"
Jul 16 12:29:49.640280 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:49.640243    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:50.001769 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:50.001685    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:50.464558 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:50.464525    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:50.641520 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:50.641485    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:53.254161 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.254125    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:53.406306 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.406272    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"]
Jul 16 12:29:53.415119 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.415092    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:53.419123 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.419097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e41619-serving-cert\""
Jul 16 12:29:53.426473 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.426432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/791f6d4d-597b-4562-b7a1-49b28859471e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:53.426559 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.426512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrg6m\" (UniqueName: \"kubernetes.io/projected/791f6d4d-597b-4562-b7a1-49b28859471e-kube-api-access-vrg6m\") pod \"maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:53.426620 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.426600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/791f6d4d-597b-4562-b7a1-49b28859471e-maas-api-tls\") pod \"maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:53.447484 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.447434    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"]
Jul 16 12:29:53.527808 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.527712    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrg6m\" (UniqueName: \"kubernetes.io/projected/791f6d4d-597b-4562-b7a1-49b28859471e-kube-api-access-vrg6m\") pod \"maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:53.527808 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.527764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/791f6d4d-597b-4562-b7a1-49b28859471e-maas-api-tls\") pod \"maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:53.528023 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.527844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/791f6d4d-597b-4562-b7a1-49b28859471e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:53.528023 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:29:53.527916    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-serving-cert: secret "maas-api-e2e-inf-b-e41619-serving-cert" not found
Jul 16 12:29:53.528023 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:29:53.527975    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/791f6d4d-597b-4562-b7a1-49b28859471e-maas-api-tls podName:791f6d4d-597b-4562-b7a1-49b28859471e nodeName:}" failed. No retries permitted until 2026-07-16 12:29:54.027958401 +0000 UTC m=+2359.142391655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/791f6d4d-597b-4562-b7a1-49b28859471e-maas-api-tls") pod "maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579" (UID: "791f6d4d-597b-4562-b7a1-49b28859471e") : secret "maas-api-e2e-inf-b-e41619-serving-cert" not found
Jul 16 12:29:53.528658 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.528639    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/791f6d4d-597b-4562-b7a1-49b28859471e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:53.551612 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.551584    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrg6m\" (UniqueName: \"kubernetes.io/projected/791f6d4d-597b-4562-b7a1-49b28859471e-kube-api-access-vrg6m\") pod \"maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:53.553650 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.553626    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:53.687639 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.687602    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:53.718431 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:53.718404    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:29:54.023205 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:54.023169    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:54.033528 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:54.033499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/791f6d4d-597b-4562-b7a1-49b28859471e-maas-api-tls\") pod \"maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:54.035997 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:54.035976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/791f6d4d-597b-4562-b7a1-49b28859471e-maas-api-tls\") pod \"maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:54.326197 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:54.326115    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:54.514244 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:54.514215    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"]
Jul 16 12:29:54.515135 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:29:54.515104    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791f6d4d_597b_4562_b7a1_49b28859471e.slice/crio-2b970b91b8e8c1f960129289c4a833da78bc12c4122096dd3afc3dd5be4a6c30 WatchSource:0}: Error finding container 2b970b91b8e8c1f960129289c4a833da78bc12c4122096dd3afc3dd5be4a6c30: Status 404 returned error can't find the container with id 2b970b91b8e8c1f960129289c4a833da78bc12c4122096dd3afc3dd5be4a6c30
Jul 16 12:29:54.707122 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:54.707083    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:54.743215 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:54.743184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579" event={"ID":"791f6d4d-597b-4562-b7a1-49b28859471e","Type":"ContainerStarted","Data":"2b970b91b8e8c1f960129289c4a833da78bc12c4122096dd3afc3dd5be4a6c30"}
Jul 16 12:29:54.898915 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:54.898886    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:29:55.749714 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:55.749679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579" event={"ID":"791f6d4d-597b-4562-b7a1-49b28859471e","Type":"ContainerStarted","Data":"aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b"}
Jul 16 12:29:55.750097 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:55.749818    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:29:55.787122 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:55.787071    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579" podStartSLOduration=2.429731188 podStartE2EDuration="2.787055366s" totalImagesPullingTime="357.324178ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:29:55.785348969 +0000 UTC m=+2360.899782243" watchObservedRunningTime="2026-07-16 12:29:55.787055366 +0000 UTC m=+2360.901488641"
Jul 16 12:29:57.795551 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:29:57.795522    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:00.230017 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.229964    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr"]
Jul 16 12:30:00.234744 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.234714    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv"]
Jul 16 12:30:00.238035 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.238005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr"
Jul 16 12:30:00.239939 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.239916    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv"
Jul 16 12:30:00.243906 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.243882    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:30:00.248717 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.248699    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr"
Jul 16 12:30:00.254599 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.254580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv"
Jul 16 12:30:00.282546 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.281952    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr"]
Jul 16 12:30:00.284717 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.284695    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv"]
Jul 16 12:30:00.413284 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.413251    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr"]
Jul 16 12:30:00.416494 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:30:00.416448    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb59b67_1121_446b_9d40_0f5ab0e7a985.slice/crio-88b05d3e023f335df11f75d86a4d1cee62c96b457782eabc17df8a717e5c4abe WatchSource:0}: Error finding container 88b05d3e023f335df11f75d86a4d1cee62c96b457782eabc17df8a717e5c4abe: Status 404 returned error can't find the container with id 88b05d3e023f335df11f75d86a4d1cee62c96b457782eabc17df8a717e5c4abe
Jul 16 12:30:00.657818 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.657794    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv"]
Jul 16 12:30:00.660415 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:30:00.660385    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e90fbb_c2dc_4f36_802d_d68d23bfa9d4.slice/crio-a53f2f8e7cb26a4b6295946588edf01fa5bb12f456e44fa598d10813bd891d94 WatchSource:0}: Error finding container a53f2f8e7cb26a4b6295946588edf01fa5bb12f456e44fa598d10813bd891d94: Status 404 returned error can't find the container with id a53f2f8e7cb26a4b6295946588edf01fa5bb12f456e44fa598d10813bd891d94
Jul 16 12:30:00.775882 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.775845    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr" event={"ID":"beb59b67-1121-446b-9d40-0f5ab0e7a985","Type":"ContainerStarted","Data":"3fd74e1b039167f84afc4a1bb91e64e457d58f43a1595d963138c61b88efaa21"}
Jul 16 12:30:00.776060 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.775901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr" event={"ID":"beb59b67-1121-446b-9d40-0f5ab0e7a985","Type":"ContainerStarted","Data":"88b05d3e023f335df11f75d86a4d1cee62c96b457782eabc17df8a717e5c4abe"}
Jul 16 12:30:00.776970 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.776942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv" event={"ID":"c5e90fbb-c2dc-4f36-802d-d68d23bfa9d4","Type":"ContainerStarted","Data":"a53f2f8e7cb26a4b6295946588edf01fa5bb12f456e44fa598d10813bd891d94"}
Jul 16 12:30:00.813335 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:00.813296    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr" podStartSLOduration=0.813282853 podStartE2EDuration="813.282853ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:30:00.812908032 +0000 UTC m=+2365.927341307" watchObservedRunningTime="2026-07-16 12:30:00.813282853 +0000 UTC m=+2365.927716110"
Jul 16 12:30:01.759691 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:01.759666    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:30:01.783730 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:01.783698    2580 generic.go:356] "Generic (PLEG): container finished" podID="beb59b67-1121-446b-9d40-0f5ab0e7a985" containerID="3fd74e1b039167f84afc4a1bb91e64e457d58f43a1595d963138c61b88efaa21" exitCode=0
Jul 16 12:30:01.783878 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:01.783791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr" event={"ID":"beb59b67-1121-446b-9d40-0f5ab0e7a985","Type":"ContainerDied","Data":"3fd74e1b039167f84afc4a1bb91e64e457d58f43a1595d963138c61b88efaa21"}
Jul 16 12:30:01.785272 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:01.785219    2580 generic.go:356] "Generic (PLEG): container finished" podID="c5e90fbb-c2dc-4f36-802d-d68d23bfa9d4" containerID="ca7599b5cc1ffbd1211dfda3388af577548a5479537b38b683d445798d617589" exitCode=0
Jul 16 12:30:01.785389 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:01.785290    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv" event={"ID":"c5e90fbb-c2dc-4f36-802d-d68d23bfa9d4","Type":"ContainerDied","Data":"ca7599b5cc1ffbd1211dfda3388af577548a5479537b38b683d445798d617589"}
Jul 16 12:30:02.932047 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:02.932024    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr"
Jul 16 12:30:02.951031 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:02.951013    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv"
Jul 16 12:30:03.798041 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:03.797945    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr"
Jul 16 12:30:03.798041 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:03.797961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736750-j8zgr" event={"ID":"beb59b67-1121-446b-9d40-0f5ab0e7a985","Type":"ContainerDied","Data":"88b05d3e023f335df11f75d86a4d1cee62c96b457782eabc17df8a717e5c4abe"}
Jul 16 12:30:03.798041 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:03.798037    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88b05d3e023f335df11f75d86a4d1cee62c96b457782eabc17df8a717e5c4abe"
Jul 16 12:30:03.799184 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:03.799167    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv"
Jul 16 12:30:03.799308 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:03.799228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv" event={"ID":"c5e90fbb-c2dc-4f36-802d-d68d23bfa9d4","Type":"ContainerDied","Data":"a53f2f8e7cb26a4b6295946588edf01fa5bb12f456e44fa598d10813bd891d94"}
Jul 16 12:30:03.799308 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:03.799267    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a53f2f8e7cb26a4b6295946588edf01fa5bb12f456e44fa598d10813bd891d94"
Jul 16 12:30:07.348842 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:07.348810    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:07.455649 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:07.455610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:14.947718 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:14.947686    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:16.037861 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:16.037817    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:16.213970 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:16.213936    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:35.550406 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:35.550375    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:30:35.552611 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:35.552587    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:30:35.553642 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:35.553624    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:30:35.556174 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:35.556155    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:30:40.435419 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.435383    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"]
Jul 16 12:30:40.435914 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.435831    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb59b67-1121-446b-9d40-0f5ab0e7a985" containerName="cleanup"
Jul 16 12:30:40.435914 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.435842    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb59b67-1121-446b-9d40-0f5ab0e7a985" containerName="cleanup"
Jul 16 12:30:40.435914 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.435852    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e90fbb-c2dc-4f36-802d-d68d23bfa9d4" containerName="cleanup"
Jul 16 12:30:40.435914 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.435857    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e90fbb-c2dc-4f36-802d-d68d23bfa9d4" containerName="cleanup"
Jul 16 12:30:40.436070 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.435931    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb59b67-1121-446b-9d40-0f5ab0e7a985" containerName="cleanup"
Jul 16 12:30:40.436070 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.435940    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5e90fbb-c2dc-4f36-802d-d68d23bfa9d4" containerName="cleanup"
Jul 16 12:30:40.440257 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.440240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.446630 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.446442    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e41619\"/\"default-dockercfg-qmjzw\""
Jul 16 12:30:40.447375 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.447356    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e41619\"/\"test-model-e41619-kserve-self-signed-certs\""
Jul 16 12:30:40.447520 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.447437    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e41619\"/\"kube-root-ca.crt\""
Jul 16 12:30:40.447583 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.447537    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e41619\"/\"openshift-service-ca.crt\""
Jul 16 12:30:40.455390 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.455364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-home\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.455536 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.455402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tls-certs\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.455536 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.455437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tmp-dir\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.455536 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.455483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf9dk\" (UniqueName: \"kubernetes.io/projected/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-kube-api-access-sf9dk\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.455536 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.455520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-model-cache\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.455733 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.455559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-dshm\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.480278 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.480253    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"]
Jul 16 12:30:40.508269 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.508236    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:30:40.556588 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.556558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf9dk\" (UniqueName: \"kubernetes.io/projected/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-kube-api-access-sf9dk\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.556724 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.556596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-model-cache\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.556724 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.556625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-dshm\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.556724 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.556686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-home\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.556724 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.556700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tls-certs\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.556929 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.556722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tmp-dir\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.557028 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.557007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-model-cache\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.557162 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.557144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tmp-dir\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.557222 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.557187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-home\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.559010 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.558994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-dshm\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.559177 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.559163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tls-certs\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.569234 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.569212    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf9dk\" (UniqueName: \"kubernetes.io/projected/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-kube-api-access-sf9dk\") pod \"test-model-e41619-kserve-7d654884bf-s6xgj\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") " pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.748759 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.748674    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:40.884324 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.884295    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"]
Jul 16 12:30:40.885148 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:30:40.885115    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50e2ef19_d9a5_49f8_b3bd_335d3af359fa.slice/crio-c6317403f13e790c121896c9e2b644dd7a333d441117ccd0b1439a80bf38a52a WatchSource:0}: Error finding container c6317403f13e790c121896c9e2b644dd7a333d441117ccd0b1439a80bf38a52a: Status 404 returned error can't find the container with id c6317403f13e790c121896c9e2b644dd7a333d441117ccd0b1439a80bf38a52a
Jul 16 12:30:40.994208 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.994178    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj" event={"ID":"50e2ef19-d9a5-49f8-b3bd-335d3af359fa","Type":"ContainerStarted","Data":"ba0cc5659f020df4fbd0050d0ac1586ca7a0fa7441a741f1e23adece8b79384d"}
Jul 16 12:30:40.994368 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:40.994222    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj" event={"ID":"50e2ef19-d9a5-49f8-b3bd-335d3af359fa","Type":"ContainerStarted","Data":"c6317403f13e790c121896c9e2b644dd7a333d441117ccd0b1439a80bf38a52a"}
Jul 16 12:30:41.020865 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:41.020779    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj" podStartSLOduration=1.020764781 podStartE2EDuration="1.020764781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:30:41.018921738 +0000 UTC m=+2406.133355013" watchObservedRunningTime="2026-07-16 12:30:41.020764781 +0000 UTC m=+2406.135198058"
Jul 16 12:30:50.749435 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:50.749402    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:50.749825 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:50.749449    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:50.761566 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:50.761537    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:30:51.055879 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:30:51.055789    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:31:02.051707 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:02.051621    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:02.986096 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:02.986065    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"]
Jul 16 12:31:04.912674 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:04.912634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:05.285107 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:05.285006    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:05.393488 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:05.393425    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:13.774806 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:13.774767    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:14.463875 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:14.463835    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:14.659927 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:14.659884    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:14.840209 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:14.840117    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"]
Jul 16 12:31:14.840677 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:14.840344    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999" podUID="24dbb1cc-c837-42e3-bfce-c5361b8874f7" containerName="maas-api" containerID="cri-o://70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d" gracePeriod=30
Jul 16 12:31:14.919335 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:14.919296    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:14.969618 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:14.969588    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv"]
Jul 16 12:31:14.985016 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:14.984986    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-e86929-29736750-862hv"]
Jul 16 12:31:15.105587 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.105535    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:31:15.177717 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.177670    2580 generic.go:356] "Generic (PLEG): container finished" podID="24dbb1cc-c837-42e3-bfce-c5361b8874f7" containerID="70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d" exitCode=0
Jul 16 12:31:15.177910 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.177738    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"
Jul 16 12:31:15.177910 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.177752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999" event={"ID":"24dbb1cc-c837-42e3-bfce-c5361b8874f7","Type":"ContainerDied","Data":"70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d"}
Jul 16 12:31:15.177910 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.177856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999" event={"ID":"24dbb1cc-c837-42e3-bfce-c5361b8874f7","Type":"ContainerDied","Data":"d0557159829e030af67d4eecde883509878fe1a9f90c2298c2c17d604ad19be9"}
Jul 16 12:31:15.177910 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.177886    2580 scope.go:117] "RemoveContainer" containerID="70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d"
Jul 16 12:31:15.186947 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.186920    2580 scope.go:117] "RemoveContainer" containerID="70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d"
Jul 16 12:31:15.187271 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:31:15.187244    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d\": container with ID starting with 70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d not found: ID does not exist" containerID="70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d"
Jul 16 12:31:15.187328 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.187285    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d"} err="failed to get container status \"70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d\": rpc error: code = NotFound desc = could not find container \"70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d\": container with ID starting with 70d70ca07091c13d5a72fec8ab273a689d2fb55d429fc8b775f3e939eaa1891d not found: ID does not exist"
Jul 16 12:31:15.278184 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.278156    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24dbb1cc-c837-42e3-bfce-c5361b8874f7-maas-api-tls\") pod \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") "
Jul 16 12:31:15.278352 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.278220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztd6n\" (UniqueName: \"kubernetes.io/projected/24dbb1cc-c837-42e3-bfce-c5361b8874f7-kube-api-access-ztd6n\") pod \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") "
Jul 16 12:31:15.278352 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.278277    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24dbb1cc-c837-42e3-bfce-c5361b8874f7-openshift-service-ca\") pod \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\" (UID: \"24dbb1cc-c837-42e3-bfce-c5361b8874f7\") "
Jul 16 12:31:15.278721 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.278687    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24dbb1cc-c837-42e3-bfce-c5361b8874f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "24dbb1cc-c837-42e3-bfce-c5361b8874f7" (UID: "24dbb1cc-c837-42e3-bfce-c5361b8874f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:31:15.280401 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.280380    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24dbb1cc-c837-42e3-bfce-c5361b8874f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "24dbb1cc-c837-42e3-bfce-c5361b8874f7" (UID: "24dbb1cc-c837-42e3-bfce-c5361b8874f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:31:15.280481 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.280427    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24dbb1cc-c837-42e3-bfce-c5361b8874f7-kube-api-access-ztd6n" (OuterVolumeSpecName: "kube-api-access-ztd6n") pod "24dbb1cc-c837-42e3-bfce-c5361b8874f7" (UID: "24dbb1cc-c837-42e3-bfce-c5361b8874f7"). InnerVolumeSpecName "kube-api-access-ztd6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:31:15.379641 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.379561    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24dbb1cc-c837-42e3-bfce-c5361b8874f7-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:15.379641 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.379589    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztd6n\" (UniqueName: \"kubernetes.io/projected/24dbb1cc-c837-42e3-bfce-c5361b8874f7-kube-api-access-ztd6n\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:15.379641 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.379602    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24dbb1cc-c837-42e3-bfce-c5361b8874f7-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:15.399185 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.399156    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5e90fbb-c2dc-4f36-802d-d68d23bfa9d4" path="/var/lib/kubelet/pods/c5e90fbb-c2dc-4f36-802d-d68d23bfa9d4/volumes"
Jul 16 12:31:15.512614 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.512582    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"]
Jul 16 12:31:15.518404 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:15.518382    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e86929-5f74494774-s2999"]
Jul 16 12:31:17.400438 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:17.400406    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24dbb1cc-c837-42e3-bfce-c5361b8874f7" path="/var/lib/kubelet/pods/24dbb1cc-c837-42e3-bfce-c5361b8874f7/volumes"
Jul 16 12:31:18.010724 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.010685    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj" podUID="50e2ef19-d9a5-49f8-b3bd-335d3af359fa" containerName="main" containerID="cri-o://ba0cc5659f020df4fbd0050d0ac1586ca7a0fa7441a741f1e23adece8b79384d" gracePeriod=45
Jul 16 12:31:18.051100 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:31:18.051069    2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50e2ef19_d9a5_49f8_b3bd_335d3af359fa.slice/crio-conmon-ba0cc5659f020df4fbd0050d0ac1586ca7a0fa7441a741f1e23adece8b79384d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50e2ef19_d9a5_49f8_b3bd_335d3af359fa.slice/crio-ba0cc5659f020df4fbd0050d0ac1586ca7a0fa7441a741f1e23adece8b79384d.scope\": RecentStats: unable to find data in memory cache]"
Jul 16 12:31:18.201583 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.201550    2580 generic.go:356] "Generic (PLEG): container finished" podID="50e2ef19-d9a5-49f8-b3bd-335d3af359fa" containerID="ba0cc5659f020df4fbd0050d0ac1586ca7a0fa7441a741f1e23adece8b79384d" exitCode=0
Jul 16 12:31:18.201733 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.201629    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj" event={"ID":"50e2ef19-d9a5-49f8-b3bd-335d3af359fa","Type":"ContainerDied","Data":"ba0cc5659f020df4fbd0050d0ac1586ca7a0fa7441a741f1e23adece8b79384d"}
Jul 16 12:31:18.265132 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.265071    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:31:18.305860 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.305819    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:18.408152 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408123    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf9dk\" (UniqueName: \"kubernetes.io/projected/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-kube-api-access-sf9dk\") pod \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") "
Jul 16 12:31:18.408152 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408156    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tls-certs\") pod \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") "
Jul 16 12:31:18.408668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408201    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-home\") pod \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") "
Jul 16 12:31:18.408668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-model-cache\") pod \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") "
Jul 16 12:31:18.408668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408297    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tmp-dir\") pod \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") "
Jul 16 12:31:18.408668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408318    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-dshm\") pod \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\" (UID: \"50e2ef19-d9a5-49f8-b3bd-335d3af359fa\") "
Jul 16 12:31:18.408668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408571    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-home" (OuterVolumeSpecName: "home") pod "50e2ef19-d9a5-49f8-b3bd-335d3af359fa" (UID: "50e2ef19-d9a5-49f8-b3bd-335d3af359fa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:31:18.408668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408586    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "50e2ef19-d9a5-49f8-b3bd-335d3af359fa" (UID: "50e2ef19-d9a5-49f8-b3bd-335d3af359fa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:31:18.408668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408603    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-model-cache" (OuterVolumeSpecName: "model-cache") pod "50e2ef19-d9a5-49f8-b3bd-335d3af359fa" (UID: "50e2ef19-d9a5-49f8-b3bd-335d3af359fa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:31:18.408956 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408693    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tmp-dir\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:18.408956 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408707    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-home\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:18.408956 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.408716    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-model-cache\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:18.410591 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.410564    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-dshm" (OuterVolumeSpecName: "dshm") pod "50e2ef19-d9a5-49f8-b3bd-335d3af359fa" (UID: "50e2ef19-d9a5-49f8-b3bd-335d3af359fa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 12:31:18.410689 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.410631    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "50e2ef19-d9a5-49f8-b3bd-335d3af359fa" (UID: "50e2ef19-d9a5-49f8-b3bd-335d3af359fa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:31:18.410689 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.410661    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-kube-api-access-sf9dk" (OuterVolumeSpecName: "kube-api-access-sf9dk") pod "50e2ef19-d9a5-49f8-b3bd-335d3af359fa" (UID: "50e2ef19-d9a5-49f8-b3bd-335d3af359fa"). InnerVolumeSpecName "kube-api-access-sf9dk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:31:18.509863 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.509828    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf9dk\" (UniqueName: \"kubernetes.io/projected/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-kube-api-access-sf9dk\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:18.509863 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.509855    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-tls-certs\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:18.509863 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:18.509866    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50e2ef19-d9a5-49f8-b3bd-335d3af359fa-dshm\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:19.207532 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:19.207494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj" event={"ID":"50e2ef19-d9a5-49f8-b3bd-335d3af359fa","Type":"ContainerDied","Data":"c6317403f13e790c121896c9e2b644dd7a333d441117ccd0b1439a80bf38a52a"}
Jul 16 12:31:19.207739 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:19.207557    2580 scope.go:117] "RemoveContainer" containerID="ba0cc5659f020df4fbd0050d0ac1586ca7a0fa7441a741f1e23adece8b79384d"
Jul 16 12:31:19.207739 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:19.207511    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"
Jul 16 12:31:19.273728 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:19.273674    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"]
Jul 16 12:31:19.280441 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:19.280413    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e41619/test-model-e41619-kserve-7d654884bf-s6xgj"]
Jul 16 12:31:19.400595 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:19.400566    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50e2ef19-d9a5-49f8-b3bd-335d3af359fa" path="/var/lib/kubelet/pods/50e2ef19-d9a5-49f8-b3bd-335d3af359fa/volumes"
Jul 16 12:31:24.606081 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:24.606050    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:24.732436 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:24.732398    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:29.084868 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.084805    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:29.331951 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.331914    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:29.476854 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.476817    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h"]
Jul 16 12:31:29.477240 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.477228    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e2ef19-d9a5-49f8-b3bd-335d3af359fa" containerName="main"
Jul 16 12:31:29.477240 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.477241    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e2ef19-d9a5-49f8-b3bd-335d3af359fa" containerName="main"
Jul 16 12:31:29.477334 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.477257    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24dbb1cc-c837-42e3-bfce-c5361b8874f7" containerName="maas-api"
Jul 16 12:31:29.477334 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.477263    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="24dbb1cc-c837-42e3-bfce-c5361b8874f7" containerName="maas-api"
Jul 16 12:31:29.477334 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.477324    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50e2ef19-d9a5-49f8-b3bd-335d3af359fa" containerName="main"
Jul 16 12:31:29.477442 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.477335    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="24dbb1cc-c837-42e3-bfce-c5361b8874f7" containerName="maas-api"
Jul 16 12:31:29.480355 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.480335    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h"
Jul 16 12:31:29.483790 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.483764    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:31:29.493214 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.493192    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h"]
Jul 16 12:31:29.498871 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.498849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f83069b6-03de-4414-9ca4-7ab33da3fe9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e41619-tx54h\" (UID: \"f83069b6-03de-4414-9ca4-7ab33da3fe9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h"
Jul 16 12:31:29.599507 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.599453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f83069b6-03de-4414-9ca4-7ab33da3fe9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e41619-tx54h\" (UID: \"f83069b6-03de-4414-9ca4-7ab33da3fe9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h"
Jul 16 12:31:29.600083 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.600065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f83069b6-03de-4414-9ca4-7ab33da3fe9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e41619-tx54h\" (UID: \"f83069b6-03de-4414-9ca4-7ab33da3fe9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h"
Jul 16 12:31:29.790782 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.790692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h"
Jul 16 12:31:29.951721 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:29.951696    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h"]
Jul 16 12:31:29.953795 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:31:29.953767    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83069b6_03de_4414_9ca4_7ab33da3fe9b.slice/crio-53a1caf1910bce7ae263f69a825574017c6a9ca7d766bd8090da8c66d4f880c9 WatchSource:0}: Error finding container 53a1caf1910bce7ae263f69a825574017c6a9ca7d766bd8090da8c66d4f880c9: Status 404 returned error can't find the container with id 53a1caf1910bce7ae263f69a825574017c6a9ca7d766bd8090da8c66d4f880c9
Jul 16 12:31:30.263338 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:30.263304    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:30.267647 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:30.267621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h" event={"ID":"f83069b6-03de-4414-9ca4-7ab33da3fe9b","Type":"ContainerStarted","Data":"1e712981b4e4fbf4789d9f8510bff77b4fb8f270d86c6454db84eeb7ae962ae3"}
Jul 16 12:31:30.267774 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:30.267670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h" event={"ID":"f83069b6-03de-4414-9ca4-7ab33da3fe9b","Type":"ContainerStarted","Data":"53a1caf1910bce7ae263f69a825574017c6a9ca7d766bd8090da8c66d4f880c9"}
Jul 16 12:31:30.316884 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:30.316835    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h" podStartSLOduration=1.316821103 podStartE2EDuration="1.316821103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:31:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:31:30.313851481 +0000 UTC m=+2455.428284758" watchObservedRunningTime="2026-07-16 12:31:30.316821103 +0000 UTC m=+2455.431254378"
Jul 16 12:31:30.681657 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:30.681629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:31.274403 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:31.274368    2580 generic.go:356] "Generic (PLEG): container finished" podID="f83069b6-03de-4414-9ca4-7ab33da3fe9b" containerID="1e712981b4e4fbf4789d9f8510bff77b4fb8f270d86c6454db84eeb7ae962ae3" exitCode=0
Jul 16 12:31:31.274885 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:31.274478    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h" event={"ID":"f83069b6-03de-4414-9ca4-7ab33da3fe9b","Type":"ContainerDied","Data":"1e712981b4e4fbf4789d9f8510bff77b4fb8f270d86c6454db84eeb7ae962ae3"}
Jul 16 12:31:32.411235 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:32.411211    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h"
Jul 16 12:31:32.424357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:32.424331    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f83069b6-03de-4414-9ca4-7ab33da3fe9b-maas-api-service-ca\") pod \"f83069b6-03de-4414-9ca4-7ab33da3fe9b\" (UID: \"f83069b6-03de-4414-9ca4-7ab33da3fe9b\") "
Jul 16 12:31:32.424729 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:32.424688    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f83069b6-03de-4414-9ca4-7ab33da3fe9b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f83069b6-03de-4414-9ca4-7ab33da3fe9b" (UID: "f83069b6-03de-4414-9ca4-7ab33da3fe9b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:31:32.525688 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:32.525658    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f83069b6-03de-4414-9ca4-7ab33da3fe9b-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:33.285722 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:33.285682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h" event={"ID":"f83069b6-03de-4414-9ca4-7ab33da3fe9b","Type":"ContainerDied","Data":"53a1caf1910bce7ae263f69a825574017c6a9ca7d766bd8090da8c66d4f880c9"}
Jul 16 12:31:33.285722 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:33.285718    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e41619-tx54h"
Jul 16 12:31:33.285987 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:33.285759    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53a1caf1910bce7ae263f69a825574017c6a9ca7d766bd8090da8c66d4f880c9"
Jul 16 12:31:39.977526 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:39.977491    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"]
Jul 16 12:31:39.977978 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:39.977710    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579" podUID="791f6d4d-597b-4562-b7a1-49b28859471e" containerName="maas-api" containerID="cri-o://aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b" gracePeriod=30
Jul 16 12:31:40.032227 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.032198    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:40.231599 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.231538    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:31:40.297337 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.297302    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/791f6d4d-597b-4562-b7a1-49b28859471e-openshift-service-ca\") pod \"791f6d4d-597b-4562-b7a1-49b28859471e\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") "
Jul 16 12:31:40.297337 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.297334    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrg6m\" (UniqueName: \"kubernetes.io/projected/791f6d4d-597b-4562-b7a1-49b28859471e-kube-api-access-vrg6m\") pod \"791f6d4d-597b-4562-b7a1-49b28859471e\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") "
Jul 16 12:31:40.297630 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.297358    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/791f6d4d-597b-4562-b7a1-49b28859471e-maas-api-tls\") pod \"791f6d4d-597b-4562-b7a1-49b28859471e\" (UID: \"791f6d4d-597b-4562-b7a1-49b28859471e\") "
Jul 16 12:31:40.297714 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.297690    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/791f6d4d-597b-4562-b7a1-49b28859471e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "791f6d4d-597b-4562-b7a1-49b28859471e" (UID: "791f6d4d-597b-4562-b7a1-49b28859471e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:31:40.299596 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.299578    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/791f6d4d-597b-4562-b7a1-49b28859471e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "791f6d4d-597b-4562-b7a1-49b28859471e" (UID: "791f6d4d-597b-4562-b7a1-49b28859471e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:31:40.299714 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.299692    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/791f6d4d-597b-4562-b7a1-49b28859471e-kube-api-access-vrg6m" (OuterVolumeSpecName: "kube-api-access-vrg6m") pod "791f6d4d-597b-4562-b7a1-49b28859471e" (UID: "791f6d4d-597b-4562-b7a1-49b28859471e"). InnerVolumeSpecName "kube-api-access-vrg6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:31:40.334102 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.334063    2580 generic.go:356] "Generic (PLEG): container finished" podID="791f6d4d-597b-4562-b7a1-49b28859471e" containerID="aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b" exitCode=0
Jul 16 12:31:40.334237 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.334103    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"
Jul 16 12:31:40.334237 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.334128    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579" event={"ID":"791f6d4d-597b-4562-b7a1-49b28859471e","Type":"ContainerDied","Data":"aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b"}
Jul 16 12:31:40.334237 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.334179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579" event={"ID":"791f6d4d-597b-4562-b7a1-49b28859471e","Type":"ContainerDied","Data":"2b970b91b8e8c1f960129289c4a833da78bc12c4122096dd3afc3dd5be4a6c30"}
Jul 16 12:31:40.334237 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.334203    2580 scope.go:117] "RemoveContainer" containerID="aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b"
Jul 16 12:31:40.343775 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.343757    2580 scope.go:117] "RemoveContainer" containerID="aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b"
Jul 16 12:31:40.344042 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:31:40.344023    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b\": container with ID starting with aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b not found: ID does not exist" containerID="aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b"
Jul 16 12:31:40.344089 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.344052    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b"} err="failed to get container status \"aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b\": rpc error: code = NotFound desc = could not find container \"aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b\": container with ID starting with aa2b1a4b9eefc8eed72bd907e85bd6f83844c782a7737d058590b96dab99065b not found: ID does not exist"
Jul 16 12:31:40.364390 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.364368    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"]
Jul 16 12:31:40.367098 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.367078    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e41619-7db8f48c9b-sx579"]
Jul 16 12:31:40.398136 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.398116    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/791f6d4d-597b-4562-b7a1-49b28859471e-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:40.398136 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.398137    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/791f6d4d-597b-4562-b7a1-49b28859471e-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:40.398276 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:40.398146    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrg6m\" (UniqueName: \"kubernetes.io/projected/791f6d4d-597b-4562-b7a1-49b28859471e-kube-api-access-vrg6m\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:31:41.400058 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:41.400023    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="791f6d4d-597b-4562-b7a1-49b28859471e" path="/var/lib/kubelet/pods/791f6d4d-597b-4562-b7a1-49b28859471e/volumes"
Jul 16 12:31:44.567741 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:44.567698    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:47.222914 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:47.222880    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:51.214379 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:51.214344    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:51.332549 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:51.332511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:55.407971 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:55.407935    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:55.684920 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:55.684831    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:56.032519 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:56.032330    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:56.447258 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:56.447207    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:56.903655 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:56.903620    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:59.871739 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:59.871699    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:31:59.991417 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:59.991388    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"]
Jul 16 12:31:59.991837 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:59.991823    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="791f6d4d-597b-4562-b7a1-49b28859471e" containerName="maas-api"
Jul 16 12:31:59.991837 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:59.991838    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="791f6d4d-597b-4562-b7a1-49b28859471e" containerName="maas-api"
Jul 16 12:31:59.991931 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:59.991852    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f83069b6-03de-4414-9ca4-7ab33da3fe9b" containerName="revoke-keys"
Jul 16 12:31:59.991931 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:59.991858    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f83069b6-03de-4414-9ca4-7ab33da3fe9b" containerName="revoke-keys"
Jul 16 12:31:59.992004 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:59.991938    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f83069b6-03de-4414-9ca4-7ab33da3fe9b" containerName="revoke-keys"
Jul 16 12:31:59.992004 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:59.991951    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="791f6d4d-597b-4562-b7a1-49b28859471e" containerName="maas-api"
Jul 16 12:31:59.995218 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:59.995200    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:31:59.997703 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:31:59.997682    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2f272c-serving-cert\""
Jul 16 12:32:00.011615 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.011586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"]
Jul 16 12:32:00.086612 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.086568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10371c26-1df6-4a42-9fcc-f93a0c385330-maas-api-tls\") pod \"maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:00.086612 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.086622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10371c26-1df6-4a42-9fcc-f93a0c385330-openshift-service-ca\") pod \"maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:00.086835 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.086662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rvmh\" (UniqueName: \"kubernetes.io/projected/10371c26-1df6-4a42-9fcc-f93a0c385330-kube-api-access-5rvmh\") pod \"maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:00.187327 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.187283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10371c26-1df6-4a42-9fcc-f93a0c385330-openshift-service-ca\") pod \"maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:00.187575 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.187343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rvmh\" (UniqueName: \"kubernetes.io/projected/10371c26-1df6-4a42-9fcc-f93a0c385330-kube-api-access-5rvmh\") pod \"maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:00.187575 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.187487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10371c26-1df6-4a42-9fcc-f93a0c385330-maas-api-tls\") pod \"maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:00.188054 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.188026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10371c26-1df6-4a42-9fcc-f93a0c385330-openshift-service-ca\") pod \"maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:00.190079 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.190059    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10371c26-1df6-4a42-9fcc-f93a0c385330-maas-api-tls\") pod \"maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:00.212240 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.212215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rvmh\" (UniqueName: \"kubernetes.io/projected/10371c26-1df6-4a42-9fcc-f93a0c385330-kube-api-access-5rvmh\") pod \"maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:00.305285 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.305241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:00.458610 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.458582    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"]
Jul 16 12:32:00.460993 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:32:00.460953    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10371c26_1df6_4a42_9fcc_f93a0c385330.slice/crio-84e7fe8665fc992206cd2b05abd4c5c44645bb6e848df7ccc96a56340a8ac5dd WatchSource:0}: Error finding container 84e7fe8665fc992206cd2b05abd4c5c44645bb6e848df7ccc96a56340a8ac5dd: Status 404 returned error can't find the container with id 84e7fe8665fc992206cd2b05abd4c5c44645bb6e848df7ccc96a56340a8ac5dd
Jul 16 12:32:00.462583 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:00.462561    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 12:32:01.444654 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:01.444613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx" event={"ID":"10371c26-1df6-4a42-9fcc-f93a0c385330","Type":"ContainerStarted","Data":"e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70"}
Jul 16 12:32:01.445091 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:01.444665    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx" event={"ID":"10371c26-1df6-4a42-9fcc-f93a0c385330","Type":"ContainerStarted","Data":"84e7fe8665fc992206cd2b05abd4c5c44645bb6e848df7ccc96a56340a8ac5dd"}
Jul 16 12:32:01.445091 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:01.444827    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:01.475451 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:01.475391    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx" podStartSLOduration=2.083598078 podStartE2EDuration="2.475372505s" totalImagesPullingTime="391.774427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:32:01.474597396 +0000 UTC m=+2486.589030672" watchObservedRunningTime="2026-07-16 12:32:01.475372505 +0000 UTC m=+2486.589805781"
Jul 16 12:32:02.192988 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:02.192954    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:02.299724 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:02.299694    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:04.310069 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:04.310035    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:04.838689 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:04.838647    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:05.241518 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:05.241481    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:05.448551 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:05.448502    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:07.456393 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:07.456361    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:08.985750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:08.985707    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:09.070304 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.070240    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"]
Jul 16 12:32:09.074340 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.074315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:09.077573 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.077551    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-347f37-serving-cert\""
Jul 16 12:32:09.101351 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.101319    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"]
Jul 16 12:32:09.110987 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.110957    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:09.172618 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.172586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259c14dd-76f9-42cf-b458-9bd11061fbb9-maas-api-tls\") pod \"maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:09.172800 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.172698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/259c14dd-76f9-42cf-b458-9bd11061fbb9-openshift-service-ca\") pod \"maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:09.172800 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.172730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cw6f\" (UniqueName: \"kubernetes.io/projected/259c14dd-76f9-42cf-b458-9bd11061fbb9-kube-api-access-9cw6f\") pod \"maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:09.255547 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.255448    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:09.273739 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.273707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259c14dd-76f9-42cf-b458-9bd11061fbb9-maas-api-tls\") pod \"maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:09.273933 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.273787    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/259c14dd-76f9-42cf-b458-9bd11061fbb9-openshift-service-ca\") pod \"maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:09.273933 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.273810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cw6f\" (UniqueName: \"kubernetes.io/projected/259c14dd-76f9-42cf-b458-9bd11061fbb9-kube-api-access-9cw6f\") pod \"maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:09.273933 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:32:09.273846    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-serving-cert: secret "maas-api-e2e-api-b-347f37-serving-cert" not found
Jul 16 12:32:09.273933 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:32:09.273906    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/259c14dd-76f9-42cf-b458-9bd11061fbb9-maas-api-tls podName:259c14dd-76f9-42cf-b458-9bd11061fbb9 nodeName:}" failed. No retries permitted until 2026-07-16 12:32:09.773890372 +0000 UTC m=+2494.888323630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/259c14dd-76f9-42cf-b458-9bd11061fbb9-maas-api-tls") pod "maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2" (UID: "259c14dd-76f9-42cf-b458-9bd11061fbb9") : secret "maas-api-e2e-api-b-347f37-serving-cert" not found
Jul 16 12:32:09.274475 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.274440    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/259c14dd-76f9-42cf-b458-9bd11061fbb9-openshift-service-ca\") pod \"maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:09.294654 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.294622    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cw6f\" (UniqueName: \"kubernetes.io/projected/259c14dd-76f9-42cf-b458-9bd11061fbb9-kube-api-access-9cw6f\") pod \"maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:09.724728 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.724692    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:09.777967 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.777925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259c14dd-76f9-42cf-b458-9bd11061fbb9-maas-api-tls\") pod \"maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:09.780701 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.780676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259c14dd-76f9-42cf-b458-9bd11061fbb9-maas-api-tls\") pod \"maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:09.945365 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.945332    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:09.984986 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:09.984897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:10.105105 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:10.105045    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:10.145605 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:10.145576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"]
Jul 16 12:32:10.147805 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:32:10.147771    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259c14dd_76f9_42cf_b458_9bd11061fbb9.slice/crio-49ec5115cb811f9e7dfdd7fb77e5fbbd096b9a15d18f98a1ddc9e7ea5fd527ab WatchSource:0}: Error finding container 49ec5115cb811f9e7dfdd7fb77e5fbbd096b9a15d18f98a1ddc9e7ea5fd527ab: Status 404 returned error can't find the container with id 49ec5115cb811f9e7dfdd7fb77e5fbbd096b9a15d18f98a1ddc9e7ea5fd527ab
Jul 16 12:32:10.493144 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:10.493112    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2" event={"ID":"259c14dd-76f9-42cf-b458-9bd11061fbb9","Type":"ContainerStarted","Data":"49ec5115cb811f9e7dfdd7fb77e5fbbd096b9a15d18f98a1ddc9e7ea5fd527ab"}
Jul 16 12:32:11.499600 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:11.499555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2" event={"ID":"259c14dd-76f9-42cf-b458-9bd11061fbb9","Type":"ContainerStarted","Data":"2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799"}
Jul 16 12:32:11.500040 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:11.499701    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:11.552742 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:11.552683    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2" podStartSLOduration=2.134572645 podStartE2EDuration="2.552665878s" totalImagesPullingTime="418.093233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:32:11.534410016 +0000 UTC m=+2496.648843292" watchObservedRunningTime="2026-07-16 12:32:11.552665878 +0000 UTC m=+2496.667099174"
Jul 16 12:32:13.416672 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:13.416635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:17.510990 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:17.510957    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:21.668821 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:21.668785    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:21.764754 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:21.764718    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:30.861819 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:30.861736    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:30.961942 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:30.961900    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:32.476192 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:32.476156    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:32.575786 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:32.575754    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:32.719482 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:32.719426    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"]
Jul 16 12:32:32.719757 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:32.719725    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx" podUID="10371c26-1df6-4a42-9fcc-f93a0c385330" containerName="maas-api" containerID="cri-o://e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70" gracePeriod=30
Jul 16 12:32:32.769956 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:32.769926    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:32.972075 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:32.972047    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:33.095228 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.095130    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rvmh\" (UniqueName: \"kubernetes.io/projected/10371c26-1df6-4a42-9fcc-f93a0c385330-kube-api-access-5rvmh\") pod \"10371c26-1df6-4a42-9fcc-f93a0c385330\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") "
Jul 16 12:32:33.095228 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.095199    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10371c26-1df6-4a42-9fcc-f93a0c385330-maas-api-tls\") pod \"10371c26-1df6-4a42-9fcc-f93a0c385330\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") "
Jul 16 12:32:33.095509 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.095264    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10371c26-1df6-4a42-9fcc-f93a0c385330-openshift-service-ca\") pod \"10371c26-1df6-4a42-9fcc-f93a0c385330\" (UID: \"10371c26-1df6-4a42-9fcc-f93a0c385330\") "
Jul 16 12:32:33.095705 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.095682    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10371c26-1df6-4a42-9fcc-f93a0c385330-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10371c26-1df6-4a42-9fcc-f93a0c385330" (UID: "10371c26-1df6-4a42-9fcc-f93a0c385330"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:32:33.097364 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.097339    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10371c26-1df6-4a42-9fcc-f93a0c385330-kube-api-access-5rvmh" (OuterVolumeSpecName: "kube-api-access-5rvmh") pod "10371c26-1df6-4a42-9fcc-f93a0c385330" (UID: "10371c26-1df6-4a42-9fcc-f93a0c385330"). InnerVolumeSpecName "kube-api-access-5rvmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:32:33.097526 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.097511    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10371c26-1df6-4a42-9fcc-f93a0c385330-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10371c26-1df6-4a42-9fcc-f93a0c385330" (UID: "10371c26-1df6-4a42-9fcc-f93a0c385330"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:32:33.196262 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.196223    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10371c26-1df6-4a42-9fcc-f93a0c385330-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:32:33.196262 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.196260    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10371c26-1df6-4a42-9fcc-f93a0c385330-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:32:33.196524 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.196275    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rvmh\" (UniqueName: \"kubernetes.io/projected/10371c26-1df6-4a42-9fcc-f93a0c385330-kube-api-access-5rvmh\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:32:33.625043 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.625004    2580 generic.go:356] "Generic (PLEG): container finished" podID="10371c26-1df6-4a42-9fcc-f93a0c385330" containerID="e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70" exitCode=0
Jul 16 12:32:33.625531 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.625054    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"
Jul 16 12:32:33.625531 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.625089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx" event={"ID":"10371c26-1df6-4a42-9fcc-f93a0c385330","Type":"ContainerDied","Data":"e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70"}
Jul 16 12:32:33.625531 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.625145    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx" event={"ID":"10371c26-1df6-4a42-9fcc-f93a0c385330","Type":"ContainerDied","Data":"84e7fe8665fc992206cd2b05abd4c5c44645bb6e848df7ccc96a56340a8ac5dd"}
Jul 16 12:32:33.625531 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.625167    2580 scope.go:117] "RemoveContainer" containerID="e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70"
Jul 16 12:32:33.634301 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.634278    2580 scope.go:117] "RemoveContainer" containerID="e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70"
Jul 16 12:32:33.634650 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:32:33.634626    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70\": container with ID starting with e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70 not found: ID does not exist" containerID="e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70"
Jul 16 12:32:33.634746 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.634655    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70"} err="failed to get container status \"e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70\": rpc error: code = NotFound desc = could not find container \"e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70\": container with ID starting with e8a9bf7894321a0a5d82220162eacbbdad0fdb3982067b9cbcb26bad6e100c70 not found: ID does not exist"
Jul 16 12:32:33.655649 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.655605    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"]
Jul 16 12:32:33.666654 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:33.666581    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f272c-5655bf55c4-gdspx"]
Jul 16 12:32:35.400822 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:35.400789    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10371c26-1df6-4a42-9fcc-f93a0c385330" path="/var/lib/kubelet/pods/10371c26-1df6-4a42-9fcc-f93a0c385330/volumes"
Jul 16 12:32:36.972939 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:36.972903    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:42.961724 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:42.961692    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:43.061724 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:43.061689    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:47.954170 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:47.954137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:48.191364 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.191330    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:48.358112 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.358025    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc"]
Jul 16 12:32:48.358568 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.358550    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10371c26-1df6-4a42-9fcc-f93a0c385330" containerName="maas-api"
Jul 16 12:32:48.358691 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.358570    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="10371c26-1df6-4a42-9fcc-f93a0c385330" containerName="maas-api"
Jul 16 12:32:48.358691 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.358675    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="10371c26-1df6-4a42-9fcc-f93a0c385330" containerName="maas-api"
Jul 16 12:32:48.362206 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.362184    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc"
Jul 16 12:32:48.366684 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.366667    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kh5ww\""
Jul 16 12:32:48.379569 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.379545    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc"]
Jul 16 12:32:48.549846 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.549807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/077d4a59-f96d-48a8-a702-df3ca9be1675-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-347f37-cglgc\" (UID: \"077d4a59-f96d-48a8-a702-df3ca9be1675\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc"
Jul 16 12:32:48.650600 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.650569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/077d4a59-f96d-48a8-a702-df3ca9be1675-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-347f37-cglgc\" (UID: \"077d4a59-f96d-48a8-a702-df3ca9be1675\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc"
Jul 16 12:32:48.651201 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.651181    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/077d4a59-f96d-48a8-a702-df3ca9be1675-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-347f37-cglgc\" (UID: \"077d4a59-f96d-48a8-a702-df3ca9be1675\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc"
Jul 16 12:32:48.675575 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.675542    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc"
Jul 16 12:32:48.851685 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:48.851658    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc"]
Jul 16 12:32:48.852765 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:32:48.852740    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077d4a59_f96d_48a8_a702_df3ca9be1675.slice/crio-a91e2278cf534049dfd70a1acfca4084ad2313ae7b47dcf795facf7c9af7d138 WatchSource:0}: Error finding container a91e2278cf534049dfd70a1acfca4084ad2313ae7b47dcf795facf7c9af7d138: Status 404 returned error can't find the container with id a91e2278cf534049dfd70a1acfca4084ad2313ae7b47dcf795facf7c9af7d138
Jul 16 12:32:49.215012 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:49.214983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:49.336328 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:49.336245    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:49.716012 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:49.715978    2580 generic.go:356] "Generic (PLEG): container finished" podID="077d4a59-f96d-48a8-a702-df3ca9be1675" containerID="be77f68a44a75add1945a6ac5c98c65dc161d309987983c2a1085f0ca6dd565e" exitCode=0
Jul 16 12:32:49.716208 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:49.716068    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc" event={"ID":"077d4a59-f96d-48a8-a702-df3ca9be1675","Type":"ContainerDied","Data":"be77f68a44a75add1945a6ac5c98c65dc161d309987983c2a1085f0ca6dd565e"}
Jul 16 12:32:49.716208 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:49.716130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc" event={"ID":"077d4a59-f96d-48a8-a702-df3ca9be1675","Type":"ContainerStarted","Data":"a91e2278cf534049dfd70a1acfca4084ad2313ae7b47dcf795facf7c9af7d138"}
Jul 16 12:32:50.857988 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:50.857962    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc"
Jul 16 12:32:50.872975 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:50.872949    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/077d4a59-f96d-48a8-a702-df3ca9be1675-maas-api-service-ca\") pod \"077d4a59-f96d-48a8-a702-df3ca9be1675\" (UID: \"077d4a59-f96d-48a8-a702-df3ca9be1675\") "
Jul 16 12:32:50.873295 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:50.873270    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/077d4a59-f96d-48a8-a702-df3ca9be1675-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "077d4a59-f96d-48a8-a702-df3ca9be1675" (UID: "077d4a59-f96d-48a8-a702-df3ca9be1675"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:32:50.974183 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:50.974099    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/077d4a59-f96d-48a8-a702-df3ca9be1675-maas-api-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:32:51.727707 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:51.727636    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc"
Jul 16 12:32:51.727707 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:51.727669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-347f37-cglgc" event={"ID":"077d4a59-f96d-48a8-a702-df3ca9be1675","Type":"ContainerDied","Data":"a91e2278cf534049dfd70a1acfca4084ad2313ae7b47dcf795facf7c9af7d138"}
Jul 16 12:32:51.727892 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:51.727714    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a91e2278cf534049dfd70a1acfca4084ad2313ae7b47dcf795facf7c9af7d138"
Jul 16 12:32:59.230578 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.230543    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"]
Jul 16 12:32:59.231079 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.230773    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2" podUID="259c14dd-76f9-42cf-b458-9bd11061fbb9" containerName="maas-api" containerID="cri-o://2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799" gracePeriod=30
Jul 16 12:32:59.310496 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.310448    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:32:59.487073 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.487015    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:59.549037 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.549009    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/259c14dd-76f9-42cf-b458-9bd11061fbb9-openshift-service-ca\") pod \"259c14dd-76f9-42cf-b458-9bd11061fbb9\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") "
Jul 16 12:32:59.549213 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.549092    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259c14dd-76f9-42cf-b458-9bd11061fbb9-maas-api-tls\") pod \"259c14dd-76f9-42cf-b458-9bd11061fbb9\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") "
Jul 16 12:32:59.549213 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.549157    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cw6f\" (UniqueName: \"kubernetes.io/projected/259c14dd-76f9-42cf-b458-9bd11061fbb9-kube-api-access-9cw6f\") pod \"259c14dd-76f9-42cf-b458-9bd11061fbb9\" (UID: \"259c14dd-76f9-42cf-b458-9bd11061fbb9\") "
Jul 16 12:32:59.549415 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.549386    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/259c14dd-76f9-42cf-b458-9bd11061fbb9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "259c14dd-76f9-42cf-b458-9bd11061fbb9" (UID: "259c14dd-76f9-42cf-b458-9bd11061fbb9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:32:59.551308 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.551277    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/259c14dd-76f9-42cf-b458-9bd11061fbb9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "259c14dd-76f9-42cf-b458-9bd11061fbb9" (UID: "259c14dd-76f9-42cf-b458-9bd11061fbb9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:32:59.551400 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.551344    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/259c14dd-76f9-42cf-b458-9bd11061fbb9-kube-api-access-9cw6f" (OuterVolumeSpecName: "kube-api-access-9cw6f") pod "259c14dd-76f9-42cf-b458-9bd11061fbb9" (UID: "259c14dd-76f9-42cf-b458-9bd11061fbb9"). InnerVolumeSpecName "kube-api-access-9cw6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:32:59.650452 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.650420    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/259c14dd-76f9-42cf-b458-9bd11061fbb9-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:32:59.650452 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.650448    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cw6f\" (UniqueName: \"kubernetes.io/projected/259c14dd-76f9-42cf-b458-9bd11061fbb9-kube-api-access-9cw6f\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:32:59.650662 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.650483    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/259c14dd-76f9-42cf-b458-9bd11061fbb9-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:32:59.778343 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.778263    2580 generic.go:356] "Generic (PLEG): container finished" podID="259c14dd-76f9-42cf-b458-9bd11061fbb9" containerID="2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799" exitCode=0
Jul 16 12:32:59.778343 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.778308    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2" event={"ID":"259c14dd-76f9-42cf-b458-9bd11061fbb9","Type":"ContainerDied","Data":"2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799"}
Jul 16 12:32:59.778343 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.778312    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"
Jul 16 12:32:59.778600 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.778350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2" event={"ID":"259c14dd-76f9-42cf-b458-9bd11061fbb9","Type":"ContainerDied","Data":"49ec5115cb811f9e7dfdd7fb77e5fbbd096b9a15d18f98a1ddc9e7ea5fd527ab"}
Jul 16 12:32:59.778600 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.778372    2580 scope.go:117] "RemoveContainer" containerID="2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799"
Jul 16 12:32:59.788168 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.788151    2580 scope.go:117] "RemoveContainer" containerID="2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799"
Jul 16 12:32:59.788423 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:32:59.788403    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799\": container with ID starting with 2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799 not found: ID does not exist" containerID="2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799"
Jul 16 12:32:59.788501 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.788431    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799"} err="failed to get container status \"2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799\": rpc error: code = NotFound desc = could not find container \"2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799\": container with ID starting with 2b18f1b660b8e23ed97508e7c39639ef6cd9e087204ada18d8caebdac2739799 not found: ID does not exist"
Jul 16 12:32:59.806793 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.806769    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"]
Jul 16 12:32:59.812602 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:32:59.812580    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-347f37-7d95fccb49-ppcl2"]
Jul 16 12:33:01.399287 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:01.399251    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="259c14dd-76f9-42cf-b458-9bd11061fbb9" path="/var/lib/kubelet/pods/259c14dd-76f9-42cf-b458-9bd11061fbb9/volumes"
Jul 16 12:33:03.508521 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:03.508482    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:09.873593 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:09.873559    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:09.960670 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:09.960635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:14.269592 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:14.269555    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:14.532702 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:14.532619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:14.900155 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:14.900125    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:15.282491 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:15.282401    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:15.988071 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:15.988024    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:18.219488 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.219434    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:18.477762 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.477682    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"]
Jul 16 12:33:18.478088 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.478076    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="259c14dd-76f9-42cf-b458-9bd11061fbb9" containerName="maas-api"
Jul 16 12:33:18.478131 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.478090    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="259c14dd-76f9-42cf-b458-9bd11061fbb9" containerName="maas-api"
Jul 16 12:33:18.478131 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.478100    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077d4a59-f96d-48a8-a702-df3ca9be1675" containerName="revoke-keys"
Jul 16 12:33:18.478131 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.478106    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="077d4a59-f96d-48a8-a702-df3ca9be1675" containerName="revoke-keys"
Jul 16 12:33:18.478227 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.478177    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="259c14dd-76f9-42cf-b458-9bd11061fbb9" containerName="maas-api"
Jul 16 12:33:18.478227 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.478186    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="077d4a59-f96d-48a8-a702-df3ca9be1675" containerName="revoke-keys"
Jul 16 12:33:18.481388 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.481369    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:18.494315 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.494293    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-a96583-serving-cert\""
Jul 16 12:33:18.537818 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.537789    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"]
Jul 16 12:33:18.542276 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.542251    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:18.626678 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.626647    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b14310-2b1f-4633-bcdf-4949fb5767f2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a96583-847f499869-bv4wp\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:18.626874 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.626688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs25q\" (UniqueName: \"kubernetes.io/projected/56b14310-2b1f-4633-bcdf-4949fb5767f2-kube-api-access-hs25q\") pod \"maas-api-e2e-shared-a-a96583-847f499869-bv4wp\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:18.626874 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.626756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b14310-2b1f-4633-bcdf-4949fb5767f2-maas-api-tls\") pod \"maas-api-e2e-shared-a-a96583-847f499869-bv4wp\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:18.691410 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.691370    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:18.727347 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.727318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b14310-2b1f-4633-bcdf-4949fb5767f2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a96583-847f499869-bv4wp\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:18.727519 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.727364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs25q\" (UniqueName: \"kubernetes.io/projected/56b14310-2b1f-4633-bcdf-4949fb5767f2-kube-api-access-hs25q\") pod \"maas-api-e2e-shared-a-a96583-847f499869-bv4wp\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:18.727519 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.727431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b14310-2b1f-4633-bcdf-4949fb5767f2-maas-api-tls\") pod \"maas-api-e2e-shared-a-a96583-847f499869-bv4wp\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:18.727624 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:33:18.727605    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-serving-cert: secret "maas-api-e2e-shared-a-a96583-serving-cert" not found
Jul 16 12:33:18.727692 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:33:18.727681    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56b14310-2b1f-4633-bcdf-4949fb5767f2-maas-api-tls podName:56b14310-2b1f-4633-bcdf-4949fb5767f2 nodeName:}" failed. No retries permitted until 2026-07-16 12:33:19.227659962 +0000 UTC m=+2564.342093216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/56b14310-2b1f-4633-bcdf-4949fb5767f2-maas-api-tls") pod "maas-api-e2e-shared-a-a96583-847f499869-bv4wp" (UID: "56b14310-2b1f-4633-bcdf-4949fb5767f2") : secret "maas-api-e2e-shared-a-a96583-serving-cert" not found
Jul 16 12:33:18.728121 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.728076    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b14310-2b1f-4633-bcdf-4949fb5767f2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a96583-847f499869-bv4wp\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:18.753874 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:18.753849    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs25q\" (UniqueName: \"kubernetes.io/projected/56b14310-2b1f-4633-bcdf-4949fb5767f2-kube-api-access-hs25q\") pod \"maas-api-e2e-shared-a-a96583-847f499869-bv4wp\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:19.084607 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:19.084510    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:19.231849 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:19.231805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b14310-2b1f-4633-bcdf-4949fb5767f2-maas-api-tls\") pod \"maas-api-e2e-shared-a-a96583-847f499869-bv4wp\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:19.234336 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:19.234309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b14310-2b1f-4633-bcdf-4949fb5767f2-maas-api-tls\") pod \"maas-api-e2e-shared-a-a96583-847f499869-bv4wp\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:19.392044 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:19.391996    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:19.546083 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:33:19.546053    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b14310_2b1f_4633_bcdf_4949fb5767f2.slice/crio-5c9af93a13b7e206f3a1c110a90a3f2de2f802934979d0461c23d2f0456a0e4f WatchSource:0}: Error finding container 5c9af93a13b7e206f3a1c110a90a3f2de2f802934979d0461c23d2f0456a0e4f: Status 404 returned error can't find the container with id 5c9af93a13b7e206f3a1c110a90a3f2de2f802934979d0461c23d2f0456a0e4f
Jul 16 12:33:19.568635 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:19.568606    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"]
Jul 16 12:33:19.881474 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:19.881429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp" event={"ID":"56b14310-2b1f-4633-bcdf-4949fb5767f2","Type":"ContainerStarted","Data":"5c9af93a13b7e206f3a1c110a90a3f2de2f802934979d0461c23d2f0456a0e4f"}
Jul 16 12:33:19.886276 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:19.886233    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:20.087434 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:20.087395    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:20.888054 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:20.888013    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp" event={"ID":"56b14310-2b1f-4633-bcdf-4949fb5767f2","Type":"ContainerStarted","Data":"4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d"}
Jul 16 12:33:20.888480 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:20.888082    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:20.951525 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:20.951452    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp" podStartSLOduration=2.508548305 podStartE2EDuration="2.951436331s" totalImagesPullingTime="442.888026ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:33:20.949647939 +0000 UTC m=+2566.064081219" watchObservedRunningTime="2026-07-16 12:33:20.951436331 +0000 UTC m=+2566.065869645"
Jul 16 12:33:22.652427 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:22.652391    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:23.110496 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:23.110381    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:23.517267 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:23.517231    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:23.684051 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:23.684016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:26.300150 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.300115    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:26.460446 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.460415    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:26.469020 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.468991    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"]
Jul 16 12:33:26.477693 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.477668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:26.483524 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.483498    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-66e9a3-serving-cert\""
Jul 16 12:33:26.495855 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.495830    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"]
Jul 16 12:33:26.593276 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.593193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:26.593276 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.593237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjd9m\" (UniqueName: \"kubernetes.io/projected/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-kube-api-access-wjd9m\") pod \"maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:26.593276 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.593256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls\") pod \"maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:26.648600 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.648554    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:26.693743 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.693721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:26.693838 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.693764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjd9m\" (UniqueName: \"kubernetes.io/projected/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-kube-api-access-wjd9m\") pod \"maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:26.693838 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.693785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls\") pod \"maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:26.693925 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:33:26.693880    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-serving-cert: secret "maas-api-e2e-shared-b-66e9a3-serving-cert" not found
Jul 16 12:33:26.693960 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:33:26.693944    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls podName:03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2 nodeName:}" failed. No retries permitted until 2026-07-16 12:33:27.193929454 +0000 UTC m=+2572.308362707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls") pod "maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k" (UID: "03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2") : secret "maas-api-e2e-shared-b-66e9a3-serving-cert" not found
Jul 16 12:33:26.694441 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.694422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:26.705600 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.705581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjd9m\" (UniqueName: \"kubernetes.io/projected/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-kube-api-access-wjd9m\") pod \"maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:26.898321 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:26.898294    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:33:27.198310 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:27.198225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls\") pod \"maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:27.198452 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:33:27.198373    2580 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-serving-cert: secret "maas-api-e2e-shared-b-66e9a3-serving-cert" not found
Jul 16 12:33:27.198452 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:33:27.198436    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls podName:03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2 nodeName:}" failed. No retries permitted until 2026-07-16 12:33:28.198420473 +0000 UTC m=+2573.312853727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls") pod "maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k" (UID: "03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2") : secret "maas-api-e2e-shared-b-66e9a3-serving-cert" not found
Jul 16 12:33:28.207969 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:28.207931    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls\") pod \"maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:28.210614 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:28.210581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls\") pod \"maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:28.287881 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:28.287842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:28.426394 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:28.426367    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"]
Jul 16 12:33:28.427963 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:33:28.427919    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ba8c0b_0994_4cb1_9d55_a3ab8aaffdc2.slice/crio-310f4fb42d331a9016f56651aaf5ba6a347dfdb304309ab93b37422e54dd9ff8 WatchSource:0}: Error finding container 310f4fb42d331a9016f56651aaf5ba6a347dfdb304309ab93b37422e54dd9ff8: Status 404 returned error can't find the container with id 310f4fb42d331a9016f56651aaf5ba6a347dfdb304309ab93b37422e54dd9ff8
Jul 16 12:33:28.929984 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:28.929948    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k" event={"ID":"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2","Type":"ContainerStarted","Data":"75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c"}
Jul 16 12:33:28.930149 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:28.930003    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k" event={"ID":"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2","Type":"ContainerStarted","Data":"310f4fb42d331a9016f56651aaf5ba6a347dfdb304309ab93b37422e54dd9ff8"}
Jul 16 12:33:28.930149 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:28.930046    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:28.957232 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:28.957180    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k" podStartSLOduration=2.611288503 podStartE2EDuration="2.957166044s" totalImagesPullingTime="345.877541ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 12:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:33:28.956034029 +0000 UTC m=+2574.070467306" watchObservedRunningTime="2026-07-16 12:33:28.957166044 +0000 UTC m=+2574.071599320"
Jul 16 12:33:29.634706 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:29.634669    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:29.716131 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:29.716092    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:33.046224 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:33.046194    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:34.940538 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:34.940507    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:33:38.266935 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:38.266898    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:38.367187 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:38.367093    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:40.921736 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:40.921695    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:42.714206 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:42.714169    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:42.812504 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:42.812452    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:49.630745 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:49.630707    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:33:49.747196 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:33:49.747166    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:34:07.891393 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:34:07.891353    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:34:28.805796 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:34:28.805756    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:35:34.451151 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:35:34.451070    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:35:35.588398 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:35:35.588363    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:35:35.593486 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:35:35.593441    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:35:35.596040 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:35:35.596021    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:35:35.599478 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:35:35.599440    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:36:04.914174 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:36:04.914141    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:36:07.748774 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:36:07.748741    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:36:13.532408 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:36:13.532377    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:36:15.122138 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:36:15.122051    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:36:25.052804 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:36:25.052768    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:36:35.753903 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:36:35.753871    2580 scope.go:117] "RemoveContainer" containerID="ca7599b5cc1ffbd1211dfda3388af577548a5479537b38b683d445798d617589"
Jul 16 12:36:54.834296 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:36:54.834261    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:36:55.128660 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:36:55.128575    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:37:40.097735 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:37:40.097698    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:37:41.205818 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:37:41.205784    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:37:45.834196 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:37:45.834152    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:37:48.111963 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:37:48.111925    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:38:09.517915 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:38:09.517882    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:38:43.660963 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:38:43.660874    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:38:43.761643 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:38:43.761603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:38:50.682081 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:38:50.682045    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:38:50.793471 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:38:50.793438    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:38:55.414297 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:38:55.414264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:38:56.613273 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:38:56.613229    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:16.521500 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:16.521466    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:16.704114 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:16.704076    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:26.585240 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.585193    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"]
Jul 16 12:39:26.585772 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.585471    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp" podUID="56b14310-2b1f-4633-bcdf-4949fb5767f2" containerName="maas-api" containerID="cri-o://4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d" gracePeriod=30
Jul 16 12:39:26.636443 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.636413    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:26.838028 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.837964    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:39:26.838425 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.838402    2580 generic.go:356] "Generic (PLEG): container finished" podID="56b14310-2b1f-4633-bcdf-4949fb5767f2" containerID="4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d" exitCode=0
Jul 16 12:39:26.838524 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.838437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp" event={"ID":"56b14310-2b1f-4633-bcdf-4949fb5767f2","Type":"ContainerDied","Data":"4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d"}
Jul 16 12:39:26.838524 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.838511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp" event={"ID":"56b14310-2b1f-4633-bcdf-4949fb5767f2","Type":"ContainerDied","Data":"5c9af93a13b7e206f3a1c110a90a3f2de2f802934979d0461c23d2f0456a0e4f"}
Jul 16 12:39:26.838595 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.838535    2580 scope.go:117] "RemoveContainer" containerID="4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d"
Jul 16 12:39:26.847071 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.847054    2580 scope.go:117] "RemoveContainer" containerID="4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d"
Jul 16 12:39:26.847320 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:39:26.847302    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d\": container with ID starting with 4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d not found: ID does not exist" containerID="4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d"
Jul 16 12:39:26.847384 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.847328    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d"} err="failed to get container status \"4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d\": rpc error: code = NotFound desc = could not find container \"4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d\": container with ID starting with 4fee4e29601d75b6a31c2a22ee07bd8d68a7f25c5d42bb0c1b80a4067f2d465d not found: ID does not exist"
Jul 16 12:39:26.967782 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.967739    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs25q\" (UniqueName: \"kubernetes.io/projected/56b14310-2b1f-4633-bcdf-4949fb5767f2-kube-api-access-hs25q\") pod \"56b14310-2b1f-4633-bcdf-4949fb5767f2\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") "
Jul 16 12:39:26.967985 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.967798    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b14310-2b1f-4633-bcdf-4949fb5767f2-openshift-service-ca\") pod \"56b14310-2b1f-4633-bcdf-4949fb5767f2\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") "
Jul 16 12:39:26.967985 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.967898    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b14310-2b1f-4633-bcdf-4949fb5767f2-maas-api-tls\") pod \"56b14310-2b1f-4633-bcdf-4949fb5767f2\" (UID: \"56b14310-2b1f-4633-bcdf-4949fb5767f2\") "
Jul 16 12:39:26.968174 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.968149    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56b14310-2b1f-4633-bcdf-4949fb5767f2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56b14310-2b1f-4633-bcdf-4949fb5767f2" (UID: "56b14310-2b1f-4633-bcdf-4949fb5767f2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:39:26.970033 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.970005    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56b14310-2b1f-4633-bcdf-4949fb5767f2-kube-api-access-hs25q" (OuterVolumeSpecName: "kube-api-access-hs25q") pod "56b14310-2b1f-4633-bcdf-4949fb5767f2" (UID: "56b14310-2b1f-4633-bcdf-4949fb5767f2"). InnerVolumeSpecName "kube-api-access-hs25q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:39:26.970142 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:26.970028    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56b14310-2b1f-4633-bcdf-4949fb5767f2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56b14310-2b1f-4633-bcdf-4949fb5767f2" (UID: "56b14310-2b1f-4633-bcdf-4949fb5767f2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:39:27.069635 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:27.069607    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b14310-2b1f-4633-bcdf-4949fb5767f2-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:39:27.069635 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:27.069632    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs25q\" (UniqueName: \"kubernetes.io/projected/56b14310-2b1f-4633-bcdf-4949fb5767f2-kube-api-access-hs25q\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:39:27.069829 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:27.069645    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b14310-2b1f-4633-bcdf-4949fb5767f2-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:39:27.844701 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:27.844622    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"
Jul 16 12:39:27.862533 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:27.862503    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"]
Jul 16 12:39:27.866113 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:27.866090    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a96583-847f499869-bv4wp"]
Jul 16 12:39:29.401268 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:29.401230    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56b14310-2b1f-4633-bcdf-4949fb5767f2" path="/var/lib/kubelet/pods/56b14310-2b1f-4633-bcdf-4949fb5767f2/volumes"
Jul 16 12:39:30.994847 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:30.994809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:37.186162 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:37.186124    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:37.624560 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:37.624468    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:41.737561 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:41.737526    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:41.982424 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:41.982391    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:42.913512 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:42.913442    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:43.010723 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:43.010684    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:52.653085 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.653044    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"]
Jul 16 12:39:52.653575 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.653269    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k" podUID="03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2" containerName="maas-api" containerID="cri-o://75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c" gracePeriod=30
Jul 16 12:39:52.743663 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.743631    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:39:52.899394 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.899369    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:39:52.977821 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.977724    2580 generic.go:356] "Generic (PLEG): container finished" podID="03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2" containerID="75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c" exitCode=0
Jul 16 12:39:52.977821 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.977773    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"
Jul 16 12:39:52.977821 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.977781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k" event={"ID":"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2","Type":"ContainerDied","Data":"75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c"}
Jul 16 12:39:52.977821 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.977824    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k" event={"ID":"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2","Type":"ContainerDied","Data":"310f4fb42d331a9016f56651aaf5ba6a347dfdb304309ab93b37422e54dd9ff8"}
Jul 16 12:39:52.978135 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.977846    2580 scope.go:117] "RemoveContainer" containerID="75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c"
Jul 16 12:39:52.987041 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.987019    2580 scope.go:117] "RemoveContainer" containerID="75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c"
Jul 16 12:39:52.987300 ip-10-0-137-84 kubenswrapper[2580]: E0716 12:39:52.987280    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c\": container with ID starting with 75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c not found: ID does not exist" containerID="75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c"
Jul 16 12:39:52.987371 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.987310    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c"} err="failed to get container status \"75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c\": rpc error: code = NotFound desc = could not find container \"75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c\": container with ID starting with 75b4be31d1f9ec330b471c3c5e501c224829987349abc38b8197977079bf670c not found: ID does not exist"
Jul 16 12:39:52.996812 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.996795    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjd9m\" (UniqueName: \"kubernetes.io/projected/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-kube-api-access-wjd9m\") pod \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") "
Jul 16 12:39:52.996889 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.996846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-openshift-service-ca\") pod \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") "
Jul 16 12:39:52.996889 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.996877    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls\") pod \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\" (UID: \"03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2\") "
Jul 16 12:39:52.997227 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.997207    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2" (UID: "03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 12:39:52.999065 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.999044    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2" (UID: "03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 12:39:52.999124 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:52.999058    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-kube-api-access-wjd9m" (OuterVolumeSpecName: "kube-api-access-wjd9m") pod "03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2" (UID: "03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2"). InnerVolumeSpecName "kube-api-access-wjd9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 12:39:53.097776 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:53.097726    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjd9m\" (UniqueName: \"kubernetes.io/projected/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-kube-api-access-wjd9m\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:39:53.097776 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:53.097772    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-openshift-service-ca\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:39:53.097776 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:53.097783    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2-maas-api-tls\") on node \"ip-10-0-137-84.ec2.internal\" DevicePath \"\""
Jul 16 12:39:53.304340 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:53.304305    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"]
Jul 16 12:39:53.310847 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:53.310819    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-66e9a3-8fc9bdb5d-whs7k"]
Jul 16 12:39:53.400218 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:53.400184    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2" path="/var/lib/kubelet/pods/03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2/volumes"
Jul 16 12:39:57.230769 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:39:57.230657    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:40:03.279772 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:03.279731    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:40:03.351123 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:03.351085    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:40:08.054491 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:08.054442    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:40:08.320668 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:08.320580    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:40:15.066334 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:15.066301    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cc89574fb-rbxqk_044f18cd-56a7-4244-bc0e-0375b91001dc/manager/0.log"
Jul 16 12:40:15.718221 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:15.718188    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d7447f8f-zr8nj_83546b63-438f-4901-bfe6-a1f4e07c76f7/manager/0.log"
Jul 16 12:40:15.724888 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:15.724863    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d7447f8f-zr8nj_83546b63-438f-4901-bfe6-a1f4e07c76f7/copy-manifests/0.log"
Jul 16 12:40:16.114844 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:16.114760    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-767ccf7cdf-m7w88_02357f57-f61b-4823-9192-8d2e3aef4a14/maas-api/0.log"
Jul 16 12:40:16.242480 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:16.242426    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736735-cg2b4_ba3d4206-6472-4afe-9833-c21374102165/cleanup/0.log"
Jul 16 12:40:16.362328 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:16.362297    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736750-j8zgr_beb59b67-1121-446b-9d40-0f5ab0e7a985/cleanup/0.log"
Jul 16 12:40:16.483592 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:16.483551    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-05da2a54-w92qw_d18b9fe1-c260-4a28-aed0-329753baf92b/revoke-keys/0.log"
Jul 16 12:40:16.602289 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:16.602256    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-59180a3f-4kwn2_ed362784-5cbc-4a17-a5b0-7b90a56f8d2c/revoke-keys/0.log"
Jul 16 12:40:16.835571 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:16.835486    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-347f37-cglgc_077d4a59-f96d-48a8-a702-df3ca9be1675/revoke-keys/0.log"
Jul 16 12:40:16.952798 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:16.952766    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-26cae25e-c6jwj_a4c89c4c-fc0f-4a21-8fdd-5209114a18e7/revoke-keys/0.log"
Jul 16 12:40:17.198750 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:17.198723    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-e41619-tx54h_f83069b6-03de-4414-9ca4-7ab33da3fe9b/revoke-keys/0.log"
Jul 16 12:40:17.317265 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:17.317238    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-953cf885-9g9g4_27a69958-11bc-474e-a7b1-67c0c35b4920/revoke-keys/0.log"
Jul 16 12:40:17.435289 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:17.435261    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-1b4f12d1-tc4qg_f7b1c5b9-6312-463d-8adf-60960cfa1a75/revoke-keys/0.log"
Jul 16 12:40:17.554442 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:17.554365    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-4a07820d-bjkfv_7ad9febf-f792-419d-8511-434e0b0764fa/revoke-keys/0.log"
Jul 16 12:40:17.913602 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:17.913573    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dv5rs_0fcaf4a6-433c-424c-ba6a-cc6dd6e06123/postgres/0.log"
Jul 16 12:40:20.766228 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:20.766193    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rl8xp_376fbe01-9407-4f41-b517-5148c3875851/discovery/0.log"
Jul 16 12:40:21.273553 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:21.273518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-7lrcd_a235c96a-fe33-4f36-8919-7350d1adab6c/payload-pre-processing/0.log"
Jul 16 12:40:21.404182 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:21.404150    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-wvd6s_5bcb3f0c-3275-4e94-a91e-d7df7baeafea/payload-processing/0.log"
Jul 16 12:40:21.907841 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:21.907809    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-4l9x9_d503ad83-9fa1-4d47-a5bb-f61c64884833/main/0.log"
Jul 16 12:40:22.031334 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:22.031287    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-p96sn_e218da8d-da63-4165-b1e6-99e5b6fb24cf/main/0.log"
Jul 16 12:40:28.674720 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:28.674685    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:40:28.786718 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:28.786688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log" limit=1024
Jul 16 12:40:31.595961 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:31.595930    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8swn6_40150948-2c25-4688-af04-4bb1b4f5518d/global-pull-secret-syncer/0.log"
Jul 16 12:40:31.728608 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:31.728580    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hdttm_25d6c4f3-c620-4017-817f-6d9981590b2a/konnectivity-agent/0.log"
Jul 16 12:40:31.883864 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:31.883831    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-84.ec2.internal_d06eb5b4eea18a477588e034fd43842d/haproxy/0.log"
Jul 16 12:40:35.627790 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:35.627764    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:40:35.631224 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:35.631204    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:40:35.631946 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:35.631930    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:40:35.635502 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:35.635483    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8hj7s_d55579c7-626e-4858-bdce-fa26629700a6/ovn-acl-logging/0.log"
Jul 16 12:40:39.591428 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:39.591403    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c0ae30-d444-4960-8ce5-5958f2f5d0ee/alertmanager/0.log"
Jul 16 12:40:39.626810 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:39.626781    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c0ae30-d444-4960-8ce5-5958f2f5d0ee/config-reloader/0.log"
Jul 16 12:40:39.663063 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:39.663035    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c0ae30-d444-4960-8ce5-5958f2f5d0ee/kube-rbac-proxy-web/0.log"
Jul 16 12:40:39.696835 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:39.696813    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c0ae30-d444-4960-8ce5-5958f2f5d0ee/kube-rbac-proxy/0.log"
Jul 16 12:40:39.727551 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:39.727526    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c0ae30-d444-4960-8ce5-5958f2f5d0ee/kube-rbac-proxy-metric/0.log"
Jul 16 12:40:39.767824 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:39.767794    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c0ae30-d444-4960-8ce5-5958f2f5d0ee/prom-label-proxy/0.log"
Jul 16 12:40:39.799069 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:39.799003    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c0ae30-d444-4960-8ce5-5958f2f5d0ee/init-config-reloader/0.log"
Jul 16 12:40:39.876467 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:39.876414    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xb4w9_d444a61f-c95d-4831-ad0f-bfe9aa85715c/kube-state-metrics/0.log"
Jul 16 12:40:39.900825 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:39.900797    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xb4w9_d444a61f-c95d-4831-ad0f-bfe9aa85715c/kube-rbac-proxy-main/0.log"
Jul 16 12:40:39.926380 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:39.926353    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-xb4w9_d444a61f-c95d-4831-ad0f-bfe9aa85715c/kube-rbac-proxy-self/0.log"
Jul 16 12:40:39.989052 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:39.989027    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-6lj7n_5f0f4537-c264-4c7f-ae53-74895ff5d656/monitoring-plugin/0.log"
Jul 16 12:40:40.111246 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.111169    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdrf2_e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a/node-exporter/0.log"
Jul 16 12:40:40.131474 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.131440    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdrf2_e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a/kube-rbac-proxy/0.log"
Jul 16 12:40:40.157249 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.157219    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hdrf2_e429eee7-1e47-4dd6-bb9d-83d4fefd2c7a/init-textfile/0.log"
Jul 16 12:40:40.272042 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.272017    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qfbqg_958df694-af55-4f14-aafd-bd38fb2f7f71/kube-rbac-proxy-main/0.log"
Jul 16 12:40:40.295372 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.295351    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qfbqg_958df694-af55-4f14-aafd-bd38fb2f7f71/kube-rbac-proxy-self/0.log"
Jul 16 12:40:40.324877 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.324854    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qfbqg_958df694-af55-4f14-aafd-bd38fb2f7f71/openshift-state-metrics/0.log"
Jul 16 12:40:40.370854 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.370791    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d484815-0c7b-45b8-b868-69f4b3289e88/prometheus/0.log"
Jul 16 12:40:40.398138 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.398117    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d484815-0c7b-45b8-b868-69f4b3289e88/config-reloader/0.log"
Jul 16 12:40:40.420577 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.420546    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d484815-0c7b-45b8-b868-69f4b3289e88/thanos-sidecar/0.log"
Jul 16 12:40:40.445031 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.445013    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d484815-0c7b-45b8-b868-69f4b3289e88/kube-rbac-proxy-web/0.log"
Jul 16 12:40:40.466343 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.466321    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d484815-0c7b-45b8-b868-69f4b3289e88/kube-rbac-proxy/0.log"
Jul 16 12:40:40.489596 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.489566    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d484815-0c7b-45b8-b868-69f4b3289e88/kube-rbac-proxy-thanos/0.log"
Jul 16 12:40:40.513252 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.513233    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d484815-0c7b-45b8-b868-69f4b3289e88/init-config-reloader/0.log"
Jul 16 12:40:40.722087 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.722057    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/thanos-query/0.log"
Jul 16 12:40:40.747941 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.747915    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/kube-rbac-proxy-web/0.log"
Jul 16 12:40:40.776877 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.776853    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/kube-rbac-proxy/0.log"
Jul 16 12:40:40.802864 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.802829    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/prom-label-proxy/0.log"
Jul 16 12:40:40.824570 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.824549    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/kube-rbac-proxy-rules/0.log"
Jul 16 12:40:40.849227 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:40.849205    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7db7488d84-bdxdj_0bde6178-ef9d-4a91-ba81-6bfaa4c46ebe/kube-rbac-proxy-metrics/0.log"
Jul 16 12:40:42.040598 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.040561    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-w5jsz_7bbd90a4-7d2b-4007-b13e-2f871309e7e9/networking-console-plugin/0.log"
Jul 16 12:40:42.595175 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.595140    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/2.log"
Jul 16 12:40:42.599722 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.599701    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bnrml_d6bdc937-2e58-4ac0-810d-60c58f8a8677/console-operator/3.log"
Jul 16 12:40:42.627473 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.627432    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"]
Jul 16 12:40:42.628024 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.627991    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56b14310-2b1f-4633-bcdf-4949fb5767f2" containerName="maas-api"
Jul 16 12:40:42.628024 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.628014    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="56b14310-2b1f-4633-bcdf-4949fb5767f2" containerName="maas-api"
Jul 16 12:40:42.628185 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.628039    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2" containerName="maas-api"
Jul 16 12:40:42.628185 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.628052    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2" containerName="maas-api"
Jul 16 12:40:42.628185 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.628131    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="56b14310-2b1f-4633-bcdf-4949fb5767f2" containerName="maas-api"
Jul 16 12:40:42.628185 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.628142    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ba8c0b-0994-4cb1-9d55-a3ab8aaffdc2" containerName="maas-api"
Jul 16 12:40:42.632850 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.632834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.636079 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.636055    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2sc8x\"/\"kube-root-ca.crt\""
Jul 16 12:40:42.636294 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.636280    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2sc8x\"/\"openshift-service-ca.crt\""
Jul 16 12:40:42.636900 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.636883    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2sc8x\"/\"default-dockercfg-hxnm7\""
Jul 16 12:40:42.638810 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.638786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-podres\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.638929 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.638842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-sys\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.638929 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.638891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-lib-modules\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.639059 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.638965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-proc\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.639059 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.639015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5tgr\" (UniqueName: \"kubernetes.io/projected/0079e1fd-a904-48ae-b6aa-6003e578118e-kube-api-access-b5tgr\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.644316 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.644294    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"]
Jul 16 12:40:42.740032 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.739995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-proc\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.740198 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.740055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5tgr\" (UniqueName: \"kubernetes.io/projected/0079e1fd-a904-48ae-b6aa-6003e578118e-kube-api-access-b5tgr\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.740198 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.740102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-proc\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.740198 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.740134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-podres\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.740198 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.740177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-sys\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.740392 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.740198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-lib-modules\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.740392 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.740227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-sys\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.740392 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.740257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-podres\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.740392 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.740337    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0079e1fd-a904-48ae-b6aa-6003e578118e-lib-modules\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.749616 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.749595    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5tgr\" (UniqueName: \"kubernetes.io/projected/0079e1fd-a904-48ae-b6aa-6003e578118e-kube-api-access-b5tgr\") pod \"perf-node-gather-daemonset-z9bd4\" (UID: \"0079e1fd-a904-48ae-b6aa-6003e578118e\") " pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:42.943659 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:42.943632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:43.083933 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:43.083905    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"]
Jul 16 12:40:43.086154 ip-10-0-137-84 kubenswrapper[2580]: W0716 12:40:43.086126    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0079e1fd_a904_48ae_b6aa_6003e578118e.slice/crio-2d823d4c54bc1e7008fa2315b9357dfd55600a1ec4d6f30f4c9f1389d73219fa WatchSource:0}: Error finding container 2d823d4c54bc1e7008fa2315b9357dfd55600a1ec4d6f30f4c9f1389d73219fa: Status 404 returned error can't find the container with id 2d823d4c54bc1e7008fa2315b9357dfd55600a1ec4d6f30f4c9f1389d73219fa
Jul 16 12:40:43.235330 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:43.235242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4" event={"ID":"0079e1fd-a904-48ae-b6aa-6003e578118e","Type":"ContainerStarted","Data":"d170103be2f07b135161867da5adda7e2e59d2e18ed8cbcf44d9beebc5bdcd91"}
Jul 16 12:40:43.235330 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:43.235297    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4" event={"ID":"0079e1fd-a904-48ae-b6aa-6003e578118e","Type":"ContainerStarted","Data":"2d823d4c54bc1e7008fa2315b9357dfd55600a1ec4d6f30f4c9f1389d73219fa"}
Jul 16 12:40:43.235579 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:43.235374    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:43.252414 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:43.252367    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4" podStartSLOduration=1.25235117 podStartE2EDuration="1.25235117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 12:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 12:40:43.251031784 +0000 UTC m=+3008.365465060" watchObservedRunningTime="2026-07-16 12:40:43.25235117 +0000 UTC m=+3008.366784445"
Jul 16 12:40:44.856769 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:44.856742    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n87tk_c167e8d9-64a9-4a36-8363-40890e887794/dns/0.log"
Jul 16 12:40:44.884510 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:44.884487    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n87tk_c167e8d9-64a9-4a36-8363-40890e887794/kube-rbac-proxy/0.log"
Jul 16 12:40:44.990850 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:44.990817    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-59grq_c8ba25d2-3518-4fc7-b87f-e5d0426a70e8/dns-node-resolver/0.log"
Jul 16 12:40:45.631343 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:45.631312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qmqbw_92fa8300-ff78-4723-a701-d94ed3a1600d/node-ca/0.log"
Jul 16 12:40:46.743990 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:46.743952    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rl8xp_376fbe01-9407-4f41-b517-5148c3875851/discovery/0.log"
Jul 16 12:40:46.884562 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:46.884532    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-7lrcd_a235c96a-fe33-4f36-8919-7350d1adab6c/payload-pre-processing/0.log"
Jul 16 12:40:46.912607 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:46.912573    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-wvd6s_5bcb3f0c-3275-4e94-a91e-d7df7baeafea/payload-processing/0.log"
Jul 16 12:40:47.721689 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:47.721660    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dks4s_7ee51f50-1a16-43a0-8c51-62f57e9cb40f/serve-healthcheck-canary/0.log"
Jul 16 12:40:48.304975 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:48.304945    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhjhp_1bcade03-751f-4323-a681-fa5bdc54e780/kube-rbac-proxy/0.log"
Jul 16 12:40:48.330410 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:48.330390    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhjhp_1bcade03-751f-4323-a681-fa5bdc54e780/exporter/0.log"
Jul 16 12:40:48.354382 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:48.354359    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhjhp_1bcade03-751f-4323-a681-fa5bdc54e780/extractor/0.log"
Jul 16 12:40:49.251268 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:49.251239    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2sc8x/perf-node-gather-daemonset-z9bd4"
Jul 16 12:40:50.861675 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:50.861642    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-cc89574fb-rbxqk_044f18cd-56a7-4244-bc0e-0375b91001dc/manager/0.log"
Jul 16 12:40:51.198281 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:51.198253    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d7447f8f-zr8nj_83546b63-438f-4901-bfe6-a1f4e07c76f7/manager/0.log"
Jul 16 12:40:51.222903 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:51.222880    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d7447f8f-zr8nj_83546b63-438f-4901-bfe6-a1f4e07c76f7/copy-manifests/0.log"
Jul 16 12:40:52.485104 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:52.485019    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rl8xp_376fbe01-9407-4f41-b517-5148c3875851/discovery/0.log"
Jul 16 12:40:52.621569 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:52.621532    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86477779b7-487sx_8b921cda-7844-4215-a71f-08db57094bcd/manager/0.log"
Jul 16 12:40:52.624873 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:52.624851    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-7lrcd_a235c96a-fe33-4f36-8919-7350d1adab6c/payload-pre-processing/0.log"
Jul 16 12:40:52.648121 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:52.648085    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-wvd6s_5bcb3f0c-3275-4e94-a91e-d7df7baeafea/payload-processing/0.log"
Jul 16 12:40:54.099545 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:54.099516    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rl8xp_376fbe01-9407-4f41-b517-5148c3875851/discovery/0.log"
Jul 16 12:40:54.218644 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:54.218557    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-7lrcd_a235c96a-fe33-4f36-8919-7350d1adab6c/payload-pre-processing/0.log"
Jul 16 12:40:54.243020 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:54.242987    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-wvd6s_5bcb3f0c-3275-4e94-a91e-d7df7baeafea/payload-processing/0.log"
Jul 16 12:40:57.623810 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:57.623772    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-25qlm_d44e5d29-9c1b-4651-9432-5264cb1ba611/migrator/0.log"
Jul 16 12:40:57.648357 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:57.648327    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-25qlm_d44e5d29-9c1b-4651-9432-5264cb1ba611/graceful-termination/0.log"
Jul 16 12:40:59.499156 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:59.499131    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zk7ff_0e3c9044-23ff-4715-9698-5c48915a00fd/kube-multus-additional-cni-plugins/0.log"
Jul 16 12:40:59.522060 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:59.522036    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zk7ff_0e3c9044-23ff-4715-9698-5c48915a00fd/egress-router-binary-copy/0.log"
Jul 16 12:40:59.547258 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:59.547228    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zk7ff_0e3c9044-23ff-4715-9698-5c48915a00fd/cni-plugins/0.log"
Jul 16 12:40:59.572269 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:59.572238    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zk7ff_0e3c9044-23ff-4715-9698-5c48915a00fd/bond-cni-plugin/0.log"
Jul 16 12:40:59.597538 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:59.597515    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zk7ff_0e3c9044-23ff-4715-9698-5c48915a00fd/routeoverride-cni/0.log"
Jul 16 12:40:59.622543 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:59.622519    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zk7ff_0e3c9044-23ff-4715-9698-5c48915a00fd/whereabouts-cni-bincopy/0.log"
Jul 16 12:40:59.649598 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:59.649572    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zk7ff_0e3c9044-23ff-4715-9698-5c48915a00fd/whereabouts-cni/0.log"
Jul 16 12:40:59.690452 ip-10-0-137-84 kubenswrapper[2580]: I0716 12:40:59.690421    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sp2t5_3856eb1f-a4be-47ae-9b83-b3b04fa6fe86/kube-multus/0.log"