Jul 15 14:30:39.991766 ip-10-0-140-118 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 14:30:40.400980 ip-10-0-140-118 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 14:30:40.400980 ip-10-0-140-118 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 14:30:40.400980 ip-10-0-140-118 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 14:30:40.400980 ip-10-0-140-118 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 14:30:40.400980 ip-10-0-140-118 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 14:30:40.403824 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.403677    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 14:30:40.412008 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.411990    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412013    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412018    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412022    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412025    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412028    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412031    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412034    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412037    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412040    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412043    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412046    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412049    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412052    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412055    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412058    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412060    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412063    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412066    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412069    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:40.412063 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412072    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412075    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412078    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412080    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412083    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412086    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412089    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412091    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412094    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412096    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412099    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412102    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412105    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412108    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412110    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412113    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412115    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412118    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412121    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412123    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:40.412579 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412126    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412128    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412132    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412136    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412140    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412142    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412145    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412148    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412151    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412155    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412157    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412160    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412163    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412165    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412169    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412172    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412176    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412180    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412183    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:40.413082 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412185    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412188    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412191    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412193    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412196    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412199    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412202    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412217    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412221    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412224    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412226    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412229    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412232    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412235    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412237    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412240    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412243    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412246    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412248    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:40.413603 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412253    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412256    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412259    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412262    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412267    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412270    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412273    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412277    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412280    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412283    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412286    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412289    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412291    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412294    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412296    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412299    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412302    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412305    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412307    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412316    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:40.414105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.412319    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413067    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413074    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413077    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413080    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413083    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413086    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413089    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413091    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413095    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413098    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413101    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413103    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413106    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413109    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413112    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413114    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413117    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413120    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413123    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:40.414720 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413127    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413130    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413135    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413139    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413142    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413145    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413149    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413153    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413156    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413159    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413163    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413167    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413170    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413174    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413177    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413180    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413182    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413185    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:40.415262 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413188    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413191    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413193    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413196    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413199    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413201    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413204    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413222    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413224    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413227    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413231    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413233    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413236    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413240    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413243    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413246    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413249    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413252    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413254    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413257    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:40.415769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413260    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413262    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413265    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413268    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413271    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413273    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413276    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413279    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413282    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413284    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413287    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413290    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413292    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413295    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413297    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413300    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413303    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413305    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413308    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413310    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:40.416301 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413313    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413316    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413318    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413321    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413324    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413328    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413331    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413334    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413337    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413339    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413342    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413344    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413347    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413350    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413353    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413355    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413359    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413362    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413367    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413371    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:40.416829 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413377    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413381    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413790    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413795    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413798    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413801    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413811    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413815    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413818    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413820    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413823    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413826    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413829    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413831    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413834    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413837    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413840    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413843    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413846    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413849    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:40.417333 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413852    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413855    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413878    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413881    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413884    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413887    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413890    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413893    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413896    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413900    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413904    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413907    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413911    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413915    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413919    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413921    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413924    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413926    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413929    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:40.417840 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413932    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413934    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413937    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413940    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413942    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413945    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413948    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413951    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413953    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413957    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413966    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413969    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413972    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413975    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413977    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413980    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413983    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413986    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413989    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413992    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:40.418378 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413994    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.413997    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414000    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414002    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414005    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414008    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414011    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414014    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414018    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414020    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414023    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414026    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414028    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414031    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414034    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414036    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414039    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414041    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414044    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414049    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:40.418886 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414053    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414056    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414061    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414064    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414067    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414070    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414073    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414077    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414079    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414082    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414085    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414088    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414091    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414094    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414097    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414099    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414102    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414105    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414109    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414113    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:40.419416 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414116    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414119    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414195    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414203    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414234    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414242    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414247    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414251    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414255    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414260    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414263    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414266    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414270    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414274    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414278    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414281    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414285    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414288    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414291    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414294    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414298    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414301    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414304    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414308    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 14:30:40.419921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414311    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414315    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414318    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414322    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414325    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414329    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414337    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414340    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414344    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414348    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414352    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414355    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414359    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414361    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414364    2574 flags.go:64] FLAG: --enable-server="true"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414367    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414373    2574 flags.go:64] FLAG: --event-burst="100"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414376    2574 flags.go:64] FLAG: --event-qps="50"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414379    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414382    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414385    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414390    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414393    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414396    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414400    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 15 14:30:40.420537 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414403    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414406    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414409    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414412    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414415    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414418    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414421    2574 flags.go:64] FLAG: --feature-gates=""
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414425    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414428    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414432    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414435    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414438    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414442    2574 flags.go:64] FLAG: --help="false"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414446    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414449    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414452    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414456    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414460    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414463    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414466    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414469    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414472    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414476    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 14:30:40.421220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414479    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414482    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414485    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414488    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414491    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414495    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414498    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414501    2574 flags.go:64] FLAG: --lock-file=""
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414504    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414507    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414510    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414516    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414519    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414522    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414525    2574 flags.go:64] FLAG: --logging-format="text"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414529    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414532    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414535    2574 flags.go:64] FLAG: --manifest-url=""
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414538    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414542    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414546    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414550    2574 flags.go:64] FLAG: --max-pods="110"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414555    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414559    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414562    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 14:30:40.421854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414565    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414569    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414572    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414575    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414582    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414586    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414589    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414593    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414596    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414602    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414605    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414609    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414612    2574 flags.go:64] FLAG: --port="10250"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414615    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414618    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06ab736ade2226385"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414621    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414624    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414627    2574 flags.go:64] FLAG: --register-node="true"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414630    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414634    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414638    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414641    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414644    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414647    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414651    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 14:30:40.422527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414654    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414657    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414660    2574 flags.go:64] FLAG: --runonce="false"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414663    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414668    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414671    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414674    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414677    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414680    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414684    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414687    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414690    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414694    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414696    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414699    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414702    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414707    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414710    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414717    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414721    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414724    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414728    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414731    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414734    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414738    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 14:30:40.423452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414741    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414744    2574 flags.go:64] FLAG: --v="2"
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414748    2574 flags.go:64] FLAG: --version="false"
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414752    2574 flags.go:64] FLAG: --vmodule=""
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414756    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.414760    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414884    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414889    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414892    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414895    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414898    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414902    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414905    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414908    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414913    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414917    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414920    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414924    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414927    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414930    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:40.424544 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414933    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414935    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414938    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414942    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414961    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414965    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414968    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414972    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414975    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414978    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414981    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414984    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414987    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414991    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414993    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414996    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.414999    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415002    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415004    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415007    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:40.425105 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415010    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415013    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415015    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415019    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415022    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415024    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415027    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415030    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415033    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415036    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415039    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415042    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415045    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415047    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415051    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415057    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415060    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415063    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415066    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:40.425673 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415069    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415072    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415075    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415078    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415081    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415084    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415088    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415091    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415094    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415096    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415099    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415102    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415105    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415108    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415111    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415114    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415117    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415119    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415122    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415125    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:40.426189 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415128    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415131    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415133    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415136    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415139    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415142    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415145    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415149    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415154    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415156    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415159    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415162    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415164    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415167    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415171    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415174    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415178    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415181    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415184    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415187    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:40.426723 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415190    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415193    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415196    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415199    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415202    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.415220    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.416089    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.425901    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.425919    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.426885    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.426898    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426961    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426966    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426970    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426974    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:40.427347 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426978    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426982    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426985    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426988    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426991    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426993    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426996    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.426999    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427002    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427005    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427008    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427011    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427023    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427026    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427029    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427032    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427034    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427037    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427040    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:40.427757 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427043    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427046    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427049    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427051    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427054    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427057    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427060    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427064    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427067    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427069    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427072    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427075    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427078    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427081    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427084    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427087    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427089    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427092    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427095    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427098    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:40.428265 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427100    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427103    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427106    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427109    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427114    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427118    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427121    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427125    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427129    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427133    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427136    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427139    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427142    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427145    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427147    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427150    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427153    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427156    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427160    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:40.428756 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427163    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427166    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427169    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427172    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427174    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427177    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427180    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427183    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427186    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427188    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427191    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427193    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427196    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427199    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427202    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427219    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427223    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427227    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427230    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427233    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:40.429241 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427235    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427238    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427241    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427244    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427247    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427251    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427255    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427258    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427261    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427264    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427267    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427271    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427274    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427277    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427280    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427283    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:40.429730 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427285    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.427291    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427433    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427440    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427444    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427447    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427450    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427453    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427456    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427459    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427462    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427465    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427468    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427471    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427475    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:30:40.430131 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427478    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427481    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427483    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427486    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427490    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427492    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427495    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427498    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427500    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427503    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427506    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427508    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427511    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427514    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427517    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427520    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427523    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427526    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427528    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427532    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:30:40.430533 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427535    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427539    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427543    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427546    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427549    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427552    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427555    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427558    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427561    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427564    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427567    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427570    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427574    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427577    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427580    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427583    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427586    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427590    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427593    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:30:40.431039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427596    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427600    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427603    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427606    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427608    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427612    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427615    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427618    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427621    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427623    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427626    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427629    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427632    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427634    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427637    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427640    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427642    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427645    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427648    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427651    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:30:40.431558 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427654    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427657    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427660    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427662    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427665    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427668    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427672    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427676    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427680    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427683    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427686    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427688    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427691    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427694    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427696    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427699    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427702    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427705    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427707    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:30:40.432076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427710    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:30:40.432572 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427713    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:30:40.432572 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427715    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:30:40.432572 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427718    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:30:40.432572 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427721    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:30:40.432572 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427723    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:30:40.432572 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427726    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:30:40.432572 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:40.427729    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:30:40.432572 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.427733    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 14:30:40.432572 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.427863    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 14:30:40.432572 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.432564    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 14:30:40.434195 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.434183    2574 server.go:1019] "Starting client certificate rotation"
Jul 15 14:30:40.434261 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.434244    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 14:30:40.434299 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.434275    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 14:30:40.437144 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.437130    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 14:30:40.438385 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.438365    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 14:30:40.450314 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.450297    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 15 14:30:40.452499 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.452485    2574 log.go:25] "Validated CRI v1 image API"
Jul 15 14:30:40.453320 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.453303    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 14:30:40.455765 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.455748    2574 fs.go:135] Filesystem UUIDs: map[77a3b215-9350-430b-8676-73e700be59d2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 829aa0ba-4a18-4bf9-bda5-a99f24d53576:/dev/nvme0n1p4]
Jul 15 14:30:40.455811 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.455766    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 14:30:40.461000 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.460868    2574 manager.go:216] Machine: {Timestamp:2026-07-15 14:30:40.459481658 +0000 UTC m=+0.352586018 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499998 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29c526b04ec26c4191627a6e043ded SystemUUID:ec29c526-b04e-c26c-4191-627a6e043ded BootID:a8cb2b44-c988-4ea4-b85c-54621726def5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:65:e8:20:71:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:65:e8:20:71:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:09:93:09:dc:79 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 14:30:40.461000 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.460997    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 14:30:40.461125 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.461073    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 14:30:40.464647 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.464440    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 14:30:40.464790 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.464650    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 14:30:40.465398 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.465386    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 14:30:40.465434 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.465401    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 14:30:40.465434 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.465409    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 14:30:40.466184 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.466172    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 14:30:40.467508 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.467497    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 14:30:40.470534 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.470521    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 14:30:40.470658 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.470648    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 14:30:40.471287 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.471277    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 14:30:40.471337 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.471290    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 14:30:40.471337 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.471308    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 14:30:40.471337 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.471317    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 15 14:30:40.471337 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.471326    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 14:30:40.471691 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.471680    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 14:30:40.471729 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.471699    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 14:30:40.474122 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.474088    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 14:30:40.475967 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.475953    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 14:30:40.476022 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.475985    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 14:30:40.476153 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476143    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 14:30:40.476183 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476158    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 14:30:40.476183 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476164    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 14:30:40.476183 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476170    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 14:30:40.476183 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476179    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 14:30:40.476183 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476184    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 14:30:40.476680 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476669    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 14:30:40.476680 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476678    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 14:30:40.476766 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476685    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 14:30:40.476766 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476691    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 14:30:40.476766 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476700    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 14:30:40.476766 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.476710    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 14:30:40.477498 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.477487    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 14:30:40.477498 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.477497    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 14:30:40.481056 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.481040    2574 server.go:1268] "Started kubelet"
Jul 15 14:30:40.481136 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.481111    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 14:30:40.481205 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.481149    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 14:30:40.481292 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.481278    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 14:30:40.481961 ip-10-0-140-118 systemd[1]: Started Kubernetes Kubelet.
Jul 15 14:30:40.482681 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.482508    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 14:30:40.483424 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.483410    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 14:30:40.483869 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.483845    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 14:30:40.484560 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.484542    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 14:30:40.484955 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.484928    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 14:30:40.485037 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.485004    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 14:30:40.486693 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.486667    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 14:30:40.487933 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.487918    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 14:30:40.488641 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.488475    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 14:30:40.488641 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.488609    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:40.489214 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.489190    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 14:30:40.489488 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.489460    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 14:30:40.489488 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.489488    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 14:30:40.489621 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.489585    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 14:30:40.489621 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.489595    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 14:30:40.489715 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.489699    2574 factory.go:55] Registering systemd factory
Jul 15 14:30:40.489715 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.489713    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 15 14:30:40.490104 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.490084    2574 factory.go:153] Registering CRI-O factory
Jul 15 14:30:40.490153 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.490109    2574 factory.go:223] Registration of the crio container factory successfully
Jul 15 14:30:40.490208 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.490175    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 14:30:40.490246 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.490216    2574 factory.go:103] Registering Raw factory
Jul 15 14:30:40.490246 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.490231    2574 manager.go:1196] Started watching for new ooms in manager
Jul 15 14:30:40.490762 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.489726    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-118.ec2.internal.18c27cffcc7738ee  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-118.ec2.internal,UID:ip-10-0-140-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-118.ec2.internal,},FirstTimestamp:2026-07-15 14:30:40.481007854 +0000 UTC m=+0.374112214,LastTimestamp:2026-07-15 14:30:40.481007854 +0000 UTC m=+0.374112214,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-118.ec2.internal,}"
Jul 15 14:30:40.490881 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.490795    2574 manager.go:349] Starting recovery of all containers
Jul 15 14:30:40.498763 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.497534    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 14:30:40.498763 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.497674    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 14:30:40.504172 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.504017    2574 manager.go:354] Recovery completed
Jul 15 14:30:40.508710 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.508697    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:40.509921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.509899    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k5vqc"
Jul 15 14:30:40.510695 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.510676    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:40.510787 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.510714    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:40.510787 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.510730    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:40.511337 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.511322    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 14:30:40.511337 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.511335    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:40.511454 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.511337    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 14:30:40.511454 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.511415    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 14:30:40.512172 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.512155    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:40.512172 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.512186    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:40.512172 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.512196    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:40.512620 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.512608    2574 policy_none.go:49] "None policy: Start"
Jul 15 14:30:40.512700 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.512624    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 14:30:40.512700 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.512658    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 14:30:40.512907 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.512844    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-118.ec2.internal.18c27cffce3c394a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-118.ec2.internal,UID:ip-10-0-140-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-118.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-118.ec2.internal,},FirstTimestamp:2026-07-15 14:30:40.510695754 +0000 UTC m=+0.403800121,LastTimestamp:2026-07-15 14:30:40.510695754 +0000 UTC m=+0.403800121,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-118.ec2.internal,}"
Jul 15 14:30:40.513752 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.513736    2574 policy_none.go:47] "Start"
Jul 15 14:30:40.520356 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.520340    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k5vqc"
Jul 15 14:30:40.522232 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.522115    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-118.ec2.internal.18c27cffce3c9ef3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-118.ec2.internal,UID:ip-10-0-140-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-118.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-118.ec2.internal,},FirstTimestamp:2026-07-15 14:30:40.510721779 +0000 UTC m=+0.403826142,LastTimestamp:2026-07-15 14:30:40.510721779 +0000 UTC m=+0.403826142,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-118.ec2.internal,}"
Jul 15 14:30:40.548801 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.548786    2574 manager.go:337] "Starting Device Plugin manager"
Jul 15 14:30:40.548895 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.548816    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 14:30:40.548895 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.548827    2574 server.go:87] "Starting device plugin registration server"
Jul 15 14:30:40.549061 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.549049    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 14:30:40.549122 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.549062    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 14:30:40.549328 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.549281    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 14:30:40.549472 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.549388    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 14:30:40.549472 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.549396    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 14:30:40.550441 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.550415    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 14:30:40.550513 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.550493    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:40.644914 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.644833    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 14:30:40.646991 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.646082    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 14:30:40.646991 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.646115    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 14:30:40.646991 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.646144    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 14:30:40.646991 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.646183    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 14:30:40.649318 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.649298    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:40.650151 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.650130    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:40.650259 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.650163    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:40.650259 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.650180    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:40.650259 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.650214    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.650847 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.650832    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:40.659693 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.659678    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.659740 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.659701    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-118.ec2.internal\": node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:40.675741 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.675718    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:40.747115 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.747068    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"]
Jul 15 14:30:40.747299 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.747200    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:40.748276 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.748257    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:40.748373 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.748290    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:40.748373 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.748300    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:40.750673 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.750661    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:40.750785 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.750771    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.750823 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.750800    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:40.751427 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.751410    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:40.751427 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.751437    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:40.751561 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.751471    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:40.751561 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.751512    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:40.751561 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.751551    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:40.751682 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.751597    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:40.753867 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.753850    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.753943 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.753879    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:40.754649 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.754630    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:40.754740 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.754673    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:40.754740 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.754683    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:40.776351 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.776318    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:40.779098 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.779068    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-118.ec2.internal\" not found" node="ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.782899 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.782880    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-118.ec2.internal\" not found" node="ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.791314 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.791297    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad6ad4f2ac9840233e2a86ee45c101a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"ad6ad4f2ac9840233e2a86ee45c101a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.791394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.791323    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad6ad4f2ac9840233e2a86ee45c101a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"ad6ad4f2ac9840233e2a86ee45c101a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.791394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.791340    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c0da50a7d7df95402dc3e08da9587549-config\") pod \"kube-apiserver-proxy-ip-10-0-140-118.ec2.internal\" (UID: \"c0da50a7d7df95402dc3e08da9587549\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.876551 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.876522    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:40.892112 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.892078    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad6ad4f2ac9840233e2a86ee45c101a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"ad6ad4f2ac9840233e2a86ee45c101a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.892112 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.892097    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad6ad4f2ac9840233e2a86ee45c101a4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"ad6ad4f2ac9840233e2a86ee45c101a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.892288 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.892133    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c0da50a7d7df95402dc3e08da9587549-config\") pod \"kube-apiserver-proxy-ip-10-0-140-118.ec2.internal\" (UID: \"c0da50a7d7df95402dc3e08da9587549\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.892288 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.892166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad6ad4f2ac9840233e2a86ee45c101a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"ad6ad4f2ac9840233e2a86ee45c101a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.892288 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.892216    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad6ad4f2ac9840233e2a86ee45c101a4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal\" (UID: \"ad6ad4f2ac9840233e2a86ee45c101a4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.892288 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:40.892228    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c0da50a7d7df95402dc3e08da9587549-config\") pod \"kube-apiserver-proxy-ip-10-0-140-118.ec2.internal\" (UID: \"c0da50a7d7df95402dc3e08da9587549\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:40.977400 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:40.977336    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:41.083944 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:41.083899    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:41.083944 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.083900    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:41.086275 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.086257    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:41.184787 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:41.184743    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:41.286702 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:41.286614    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:41.365926 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.365896    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:41.387731 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:41.387702    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:41.435643 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.435611    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 14:30:41.436131 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.435785    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 14:30:41.436131 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.435792    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 14:30:41.450791 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.450771    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:41.487780 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:41.487751    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:41.523165 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.523112    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 14:25:40 +0000 UTC" deadline="2028-02-12 09:32:52.170934961 +0000 UTC"
Jul 15 14:30:41.523165 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.523163    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13843h2m10.647776006s"
Jul 15 14:30:41.561801 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.561781    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:30:41.564174 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.564136    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:30:41.564302 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.564191    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:30:41.564302 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.564206    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:30:41.588489 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:41.588466    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:41.674695 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:41.674663    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0da50a7d7df95402dc3e08da9587549.slice/crio-9cd35e1705d5a68079f16c2c8761ebab478588582cb96641545e6eb16ddf3233 WatchSource:0}: Error finding container 9cd35e1705d5a68079f16c2c8761ebab478588582cb96641545e6eb16ddf3233: Status 404 returned error can't find the container with id 9cd35e1705d5a68079f16c2c8761ebab478588582cb96641545e6eb16ddf3233
Jul 15 14:30:41.679501 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.679483    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:30:41.689450 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:41.689415    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-118.ec2.internal\" not found"
Jul 15 14:30:41.695609 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.695592    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:41.794574 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.794514    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:41.824733 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.824654    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 14:30:41.825767 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.825750    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal"
Jul 15 14:30:41.843838 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:41.843814    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 14:30:41.917494 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:41.917458    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6ad4f2ac9840233e2a86ee45c101a4.slice/crio-b2a9defe6a07f469589e83d2fd8a980a407576ec2db4f4d18e844960b0d3e185 WatchSource:0}: Error finding container b2a9defe6a07f469589e83d2fd8a980a407576ec2db4f4d18e844960b0d3e185: Status 404 returned error can't find the container with id b2a9defe6a07f469589e83d2fd8a980a407576ec2db4f4d18e844960b0d3e185
Jul 15 14:30:42.472427 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.472390    2574 apiserver.go:52] "Watching apiserver"
Jul 15 14:30:42.481815 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.481787    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 14:30:42.482989 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.482961    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-9swdm","openshift-ovn-kubernetes/ovnkube-node-w9lj2","kube-system/konnectivity-agent-425hb","kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x74x5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal","openshift-multus/multus-additional-cni-plugins-gcgjm","openshift-multus/network-metrics-daemon-5qsjj","openshift-network-operator/iptables-alerter-xqcf6","kube-system/global-pull-secret-syncer-hr7xh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl","openshift-dns/node-resolver-m4b6r","openshift-image-registry/node-ca-9lhc5","openshift-multus/multus-v5xbg"]
Jul 15 14:30:42.485949 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.485919    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:42.486067 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:42.486012    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:30:42.488265 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.488238    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9lhc5"
Jul 15 14:30:42.489016 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.488990    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 14:30:42.490758 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.490727    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:30:42.493334 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.493310    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.493883 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.493861    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 14:30:42.494071 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.494051    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 14:30:42.494141 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.494130    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7w6lm\""
Jul 15 14:30:42.494404 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.494388    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 14:30:42.495865 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.495847    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 14:30:42.496352 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.496038    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tj2x2\""
Jul 15 14:30:42.496352 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.496235    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 14:30:42.497129 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.496639    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.498388 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.498369    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 14:30:42.498500 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.498403    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 14:30:42.498825 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.498798    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:42.498916 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:42.498894    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:30:42.499218 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.499140    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 14:30:42.499338 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.499314    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 14:30:42.501594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.500284    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:30:42.501594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.500517    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87271241-2e0f-48e4-a296-7842b26dd134-kubelet-config\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:42.501594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.500546    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87271241-2e0f-48e4-a296-7842b26dd134-dbus\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:42.501594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.500570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55c22770-2f5a-40f0-b5cd-bcf852bf9109-serviceca\") pod \"node-ca-9lhc5\" (UID: \"55c22770-2f5a-40f0-b5cd-bcf852bf9109\") " pod="openshift-image-registry/node-ca-9lhc5"
Jul 15 14:30:42.501594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.500597    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a27a6c6-2eee-49da-a95b-ce98f3d8418b-konnectivity-ca\") pod \"konnectivity-agent-425hb\" (UID: \"4a27a6c6-2eee-49da-a95b-ce98f3d8418b\") " pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:30:42.501594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.500631    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:42.501594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.500657    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55c22770-2f5a-40f0-b5cd-bcf852bf9109-host\") pod \"node-ca-9lhc5\" (UID: \"55c22770-2f5a-40f0-b5cd-bcf852bf9109\") " pod="openshift-image-registry/node-ca-9lhc5"
Jul 15 14:30:42.501594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.500682    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn9wn\" (UniqueName: \"kubernetes.io/projected/55c22770-2f5a-40f0-b5cd-bcf852bf9109-kube-api-access-pn9wn\") pod \"node-ca-9lhc5\" (UID: \"55c22770-2f5a-40f0-b5cd-bcf852bf9109\") " pod="openshift-image-registry/node-ca-9lhc5"
Jul 15 14:30:42.501594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.500707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a27a6c6-2eee-49da-a95b-ce98f3d8418b-agent-certs\") pod \"konnectivity-agent-425hb\" (UID: \"4a27a6c6-2eee-49da-a95b-ce98f3d8418b\") " pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:30:42.502039 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.501900    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xqcf6"
Jul 15 14:30:42.504244 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.504221    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.506885 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.506860    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.510797 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.509115    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9xwxm\""
Jul 15 14:30:42.510797 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.509185    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s8dvn\""
Jul 15 14:30:42.510797 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.509610    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 14:30:42.511611 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.511587    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 14:30:42.511704 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.511669    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 14:30:42.511762 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.511672    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:30:42.512583 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.511988    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d529f\""
Jul 15 14:30:42.512583 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.512295    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:42.512583 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:42.512377    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:30:42.512583 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.512302    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 14:30:42.514309 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.514290    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dt96v\""
Jul 15 14:30:42.514858 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.514843    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.517552 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.517527    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m4b6r"
Jul 15 14:30:42.519009 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.518963    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 14:30:42.519009 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.518993    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 14:30:42.519204 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.519118    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 14:30:42.519271 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.519250    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 14:30:42.519327 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.519272    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:42.519385 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.519352    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 14:30:42.519502 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.519486    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 14:30:42.519616 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.519600    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 14:30:42.521978 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.521957    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 14:30:42.522532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.522516    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 14:30:42.524267 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.524250    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d85l6\""
Jul 15 14:30:42.524424 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.524290    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 14:30:42.524536 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.524298    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 14:30:42.524597 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.524356    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cwd8r\""
Jul 15 14:30:42.524685 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.524359    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b256m\""
Jul 15 14:30:42.524780 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.524369    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 14:30:42.537776 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.537753    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 14:30:42.588835 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.588795    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2zxkg"
Jul 15 14:30:42.590662 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.590580    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 14:30:42.601230 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-lib-modules\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.601356 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601252    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87271241-2e0f-48e4-a296-7842b26dd134-dbus\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:42.601356 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601281    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55c22770-2f5a-40f0-b5cd-bcf852bf9109-serviceca\") pod \"node-ca-9lhc5\" (UID: \"55c22770-2f5a-40f0-b5cd-bcf852bf9109\") " pod="openshift-image-registry/node-ca-9lhc5"
Jul 15 14:30:42.601356 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601334    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-run-openvswitch\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.601523 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601392    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-run-ovn\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.601523 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601425    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgd9n\" (UniqueName: \"kubernetes.io/projected/7960d43c-998b-486e-9138-e015127e6877-kube-api-access-mgd9n\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:42.601523 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601467    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.601523 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-socket-dir-parent\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.601723 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a27a6c6-2eee-49da-a95b-ce98f3d8418b-agent-certs\") pod \"konnectivity-agent-425hb\" (UID: \"4a27a6c6-2eee-49da-a95b-ce98f3d8418b\") " pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:30:42.601723 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601578    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-cni-netd\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.601723 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601605    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f326744a-b5d2-478d-88a0-f2b4a3ee2774-cni-binary-copy\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.601723 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601629    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-var-lib-kubelet\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.601723 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601662    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-conf-dir\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.601723 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601698    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-cni-dir\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.601723 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601721    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-hostroot\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.602065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601837    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-etc-kubernetes\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.602065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601867    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-systemd\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.602065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601881    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55c22770-2f5a-40f0-b5cd-bcf852bf9109-serviceca\") pod \"node-ca-9lhc5\" (UID: \"55c22770-2f5a-40f0-b5cd-bcf852bf9109\") " pod="openshift-image-registry/node-ca-9lhc5"
Jul 15 14:30:42.602065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f237f45-35f3-4d5f-b809-951798d6353e-tmp\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.602065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601921    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-daemon-config\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.602065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-run-multus-certs\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.602065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.601981    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a27a6c6-2eee-49da-a95b-ce98f3d8418b-konnectivity-ca\") pod \"konnectivity-agent-425hb\" (UID: \"4a27a6c6-2eee-49da-a95b-ce98f3d8418b\") " pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:30:42.602065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602016    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-run-systemd\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.602065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602045    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-etc-openvswitch\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602050    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87271241-2e0f-48e4-a296-7842b26dd134-dbus\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602099    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602132    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602176    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45shb\" (UniqueName: \"kubernetes.io/projected/f326744a-b5d2-478d-88a0-f2b4a3ee2774-kube-api-access-45shb\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602220    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-sysctl-conf\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602216    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602250    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0f914685-9d69-4de0-9ff0-c7f5389607d5-iptables-alerter-script\") pod \"iptables-alerter-xqcf6\" (UID: \"0f914685-9d69-4de0-9ff0-c7f5389607d5\") " pod="openshift-network-operator/iptables-alerter-xqcf6"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-slash\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602302    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-var-lib-openvswitch\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602320    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-ovnkube-script-lib\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602363    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-etc-selinux\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602388    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l76s\" (UniqueName: \"kubernetes.io/projected/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-kube-api-access-7l76s\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602406    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d09b0399-d94d-4fab-be6c-912f4fd178d0-tmp-dir\") pod \"node-resolver-m4b6r\" (UID: \"d09b0399-d94d-4fab-be6c-912f4fd178d0\") " pod="openshift-dns/node-resolver-m4b6r"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87271241-2e0f-48e4-a296-7842b26dd134-kubelet-config\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:42.602531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602492    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-node-log\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602548    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87271241-2e0f-48e4-a296-7842b26dd134-kubelet-config\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602572    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a27a6c6-2eee-49da-a95b-ce98f3d8418b-konnectivity-ca\") pod \"konnectivity-agent-425hb\" (UID: \"4a27a6c6-2eee-49da-a95b-ce98f3d8418b\") " pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602576    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-os-release\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-var-lib-cni-bin\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602668    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-kubernetes\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602693    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-sysctl-d\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-socket-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602773    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-sys-fs\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602809    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-system-cni-dir\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602833    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-cnibin\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55c22770-2f5a-40f0-b5cd-bcf852bf9109-host\") pod \"node-ca-9lhc5\" (UID: \"55c22770-2f5a-40f0-b5cd-bcf852bf9109\") " pod="openshift-image-registry/node-ca-9lhc5"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602883    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-kubelet\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602924    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-run-netns\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602945    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55c22770-2f5a-40f0-b5cd-bcf852bf9109-host\") pod \"node-ca-9lhc5\" (UID: \"55c22770-2f5a-40f0-b5cd-bcf852bf9109\") " pod="openshift-image-registry/node-ca-9lhc5"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602956    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-device-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.602981    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnplx\" (UniqueName: \"kubernetes.io/projected/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-kube-api-access-gnplx\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.603274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603009    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-os-release\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-log-socket\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603108    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-cni-bin\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603143    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-ovnkube-config\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603166    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-host\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f914685-9d69-4de0-9ff0-c7f5389607d5-host-slash\") pod \"iptables-alerter-xqcf6\" (UID: \"0f914685-9d69-4de0-9ff0-c7f5389607d5\") " pod="openshift-network-operator/iptables-alerter-xqcf6"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603243    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603316    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-run\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:42.603342    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603358    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-systemd-units\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:42.603421    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret podName:87271241-2e0f-48e4-a296-7842b26dd134 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:43.103397873 +0000 UTC m=+2.996502235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret") pod "global-pull-secret-syncer-hr7xh" (UID: "87271241-2e0f-48e4-a296-7842b26dd134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-registration-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603485    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-system-cni-dir\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603515    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-var-lib-kubelet\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603541    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f237f45-35f3-4d5f-b809-951798d6353e-etc-tuned\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.604180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhz5f\" (UniqueName: \"kubernetes.io/projected/1f237f45-35f3-4d5f-b809-951798d6353e-kube-api-access-jhz5f\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg95d\" (UniqueName: \"kubernetes.io/projected/d09b0399-d94d-4fab-be6c-912f4fd178d0-kube-api-access-qg95d\") pod \"node-resolver-m4b6r\" (UID: \"d09b0399-d94d-4fab-be6c-912f4fd178d0\") " pod="openshift-dns/node-resolver-m4b6r"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603615    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-run-k8s-cni-cncf-io\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603641    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-modprobe-d\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-sysconfig\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603691    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6ftx\" (UniqueName: \"kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx\") pod \"network-check-target-9swdm\" (UID: \"a4d3a2e0-b568-46a0-bdd8-c80704c57326\") " pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603745    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-cnibin\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603771    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603815    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d09b0399-d94d-4fab-be6c-912f4fd178d0-hosts-file\") pod \"node-resolver-m4b6r\" (UID: \"d09b0399-d94d-4fab-be6c-912f4fd178d0\") " pod="openshift-dns/node-resolver-m4b6r"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603841    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-sys\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn9wn\" (UniqueName: \"kubernetes.io/projected/55c22770-2f5a-40f0-b5cd-bcf852bf9109-kube-api-access-pn9wn\") pod \"node-ca-9lhc5\" (UID: \"55c22770-2f5a-40f0-b5cd-bcf852bf9109\") " pod="openshift-image-registry/node-ca-9lhc5"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603909    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-var-lib-cni-multus\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603942    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-env-overrides\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.603977    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.604018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.604038    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-run-netns\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.605011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.604061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8xj9\" (UniqueName: \"kubernetes.io/projected/0f914685-9d69-4de0-9ff0-c7f5389607d5-kube-api-access-s8xj9\") pod \"iptables-alerter-xqcf6\" (UID: \"0f914685-9d69-4de0-9ff0-c7f5389607d5\") " pod="openshift-network-operator/iptables-alerter-xqcf6"
Jul 15 14:30:42.605882 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.604085    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-ovn-node-metrics-cert\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.605882 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.604109    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qprv9\" (UniqueName: \"kubernetes.io/projected/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-kube-api-access-qprv9\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.605882 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.604125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-run-ovn-kubernetes\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.609083 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.609062    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a27a6c6-2eee-49da-a95b-ce98f3d8418b-agent-certs\") pod \"konnectivity-agent-425hb\" (UID: \"4a27a6c6-2eee-49da-a95b-ce98f3d8418b\") " pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:30:42.626198 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.626172    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2zxkg"
Jul 15 14:30:42.635389 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.635364    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn9wn\" (UniqueName: \"kubernetes.io/projected/55c22770-2f5a-40f0-b5cd-bcf852bf9109-kube-api-access-pn9wn\") pod \"node-ca-9lhc5\" (UID: \"55c22770-2f5a-40f0-b5cd-bcf852bf9109\") " pod="openshift-image-registry/node-ca-9lhc5"
Jul 15 14:30:42.653173 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.653109    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal" event={"ID":"c0da50a7d7df95402dc3e08da9587549","Type":"ContainerStarted","Data":"9cd35e1705d5a68079f16c2c8761ebab478588582cb96641545e6eb16ddf3233"}
Jul 15 14:30:42.654668 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.654452    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal" event={"ID":"ad6ad4f2ac9840233e2a86ee45c101a4","Type":"ContainerStarted","Data":"b2a9defe6a07f469589e83d2fd8a980a407576ec2db4f4d18e844960b0d3e185"}
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704466    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-var-lib-kubelet\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704511    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f237f45-35f3-4d5f-b809-951798d6353e-etc-tuned\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704541    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhz5f\" (UniqueName: \"kubernetes.io/projected/1f237f45-35f3-4d5f-b809-951798d6353e-kube-api-access-jhz5f\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg95d\" (UniqueName: \"kubernetes.io/projected/d09b0399-d94d-4fab-be6c-912f4fd178d0-kube-api-access-qg95d\") pod \"node-resolver-m4b6r\" (UID: \"d09b0399-d94d-4fab-be6c-912f4fd178d0\") " pod="openshift-dns/node-resolver-m4b6r"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-run-k8s-cni-cncf-io\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704618    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-modprobe-d\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-sysconfig\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704652    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ftx\" (UniqueName: \"kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx\") pod \"network-check-target-9swdm\" (UID: \"a4d3a2e0-b568-46a0-bdd8-c80704c57326\") " pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704672    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-cnibin\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704721    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d09b0399-d94d-4fab-be6c-912f4fd178d0-hosts-file\") pod \"node-resolver-m4b6r\" (UID: \"d09b0399-d94d-4fab-be6c-912f4fd178d0\") " pod="openshift-dns/node-resolver-m4b6r"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704736    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-sys\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704752    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-var-lib-cni-multus\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704770    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-env-overrides\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704816    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.706782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-run-netns\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704861    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8xj9\" (UniqueName: \"kubernetes.io/projected/0f914685-9d69-4de0-9ff0-c7f5389607d5-kube-api-access-s8xj9\") pod \"iptables-alerter-xqcf6\" (UID: \"0f914685-9d69-4de0-9ff0-c7f5389607d5\") " pod="openshift-network-operator/iptables-alerter-xqcf6"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704882    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-ovn-node-metrics-cert\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.704966    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-cnibin\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705017    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qprv9\" (UniqueName: \"kubernetes.io/projected/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-kube-api-access-qprv9\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705066    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-run-ovn-kubernetes\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705085    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-lib-modules\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705105    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-run-openvswitch\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705162    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-run-ovn\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgd9n\" (UniqueName: \"kubernetes.io/projected/7960d43c-998b-486e-9138-e015127e6877-kube-api-access-mgd9n\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705194    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705210    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-socket-dir-parent\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705231    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-cni-netd\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705255    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f326744a-b5d2-478d-88a0-f2b4a3ee2774-cni-binary-copy\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705279    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-var-lib-kubelet\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705306    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-conf-dir\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-cni-dir\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.707764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705357    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-hostroot\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-etc-kubernetes\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-systemd\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705434    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f237f45-35f3-4d5f-b809-951798d6353e-tmp\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-daemon-config\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705484    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-run-multus-certs\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705511    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-run-systemd\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705535    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-etc-openvswitch\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705561    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705595    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705624    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45shb\" (UniqueName: \"kubernetes.io/projected/f326744a-b5d2-478d-88a0-f2b4a3ee2774-kube-api-access-45shb\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705648    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-sysctl-conf\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705674    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0f914685-9d69-4de0-9ff0-c7f5389607d5-iptables-alerter-script\") pod \"iptables-alerter-xqcf6\" (UID: \"0f914685-9d69-4de0-9ff0-c7f5389607d5\") " pod="openshift-network-operator/iptables-alerter-xqcf6"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705700    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-slash\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-var-lib-openvswitch\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-ovnkube-script-lib\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705784    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-etc-selinux\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.708699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705811    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l76s\" (UniqueName: \"kubernetes.io/projected/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-kube-api-access-7l76s\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705813    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-env-overrides\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705837    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d09b0399-d94d-4fab-be6c-912f4fd178d0-tmp-dir\") pod \"node-resolver-m4b6r\" (UID: \"d09b0399-d94d-4fab-be6c-912f4fd178d0\") " pod="openshift-dns/node-resolver-m4b6r"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-node-log\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705906    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-os-release\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-var-lib-cni-bin\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705966    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-kubernetes\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.705993    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-sysctl-d\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706021    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-socket-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706048    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-sys-fs\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706078    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-system-cni-dir\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706105    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-cnibin\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706149    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-kubelet\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706165    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d09b0399-d94d-4fab-be6c-912f4fd178d0-tmp-dir\") pod \"node-resolver-m4b6r\" (UID: \"d09b0399-d94d-4fab-be6c-912f4fd178d0\") " pod="openshift-dns/node-resolver-m4b6r"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706221    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-run-netns\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706251    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-device-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706277    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnplx\" (UniqueName: \"kubernetes.io/projected/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-kube-api-access-gnplx\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.709532 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706297    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-var-lib-kubelet\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706302    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-os-release\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-log-socket\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706373    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-os-release\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706383    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-cni-bin\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-ovnkube-config\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-host\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706476    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f914685-9d69-4de0-9ff0-c7f5389607d5-host-slash\") pod \"iptables-alerter-xqcf6\" (UID: \"0f914685-9d69-4de0-9ff0-c7f5389607d5\") " pod="openshift-network-operator/iptables-alerter-xqcf6"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706554    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-run\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706580    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-systemd-units\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706609    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-registration-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706637    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-system-cni-dir\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.706747    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-system-cni-dir\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.707934    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.707984    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-ovn-node-metrics-cert\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708014    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d09b0399-d94d-4fab-be6c-912f4fd178d0-hosts-file\") pod \"node-resolver-m4b6r\" (UID: \"d09b0399-d94d-4fab-be6c-912f4fd178d0\") " pod="openshift-dns/node-resolver-m4b6r"
Jul 15 14:30:42.710394 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708077    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-sys\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708121    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-var-lib-cni-multus\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708156    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-node-log\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708255    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-os-release\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708297    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-var-lib-cni-bin\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708344    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-kubernetes\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708481    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-sysctl-d\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708506    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708590    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-socket-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:42.708597    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708651    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-sys-fs\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:42.708657    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs podName:7960d43c-998b-486e-9138-e015127e6877 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:43.208638456 +0000 UTC m=+3.101742808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs") pod "network-metrics-daemon-5qsjj" (UID: "7960d43c-998b-486e-9138-e015127e6877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708714    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-system-cni-dir\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708770    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-cnibin\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708818    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-kubelet\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708861    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-run-netns\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708910    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-device-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.711279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.708950    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-run-netns\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.709814    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-run-ovn\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710084    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f237f45-35f3-4d5f-b809-951798d6353e-etc-tuned\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710259    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-run-k8s-cni-cncf-io\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710376    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-modprobe-d\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710428    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-sysconfig\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710691    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-daemon-config\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-run-multus-certs\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710808    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-run-systemd\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710829    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-run-ovn-kubernetes\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710846    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-etc-openvswitch\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710895    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710945    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-lib-modules\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710951    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-kubelet-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.710999    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-run-openvswitch\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.711041    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-log-socket\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.711166    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-sysctl-conf\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.711202    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-cni-bin\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.712142 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.711610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f237f45-35f3-4d5f-b809-951798d6353e-tmp\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.711747    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-ovnkube-config\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.711774    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0f914685-9d69-4de0-9ff0-c7f5389607d5-iptables-alerter-script\") pod \"iptables-alerter-xqcf6\" (UID: \"0f914685-9d69-4de0-9ff0-c7f5389607d5\") " pod="openshift-network-operator/iptables-alerter-xqcf6"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.711832    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-host\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.711843    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-slash\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.711885    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f914685-9d69-4de0-9ff0-c7f5389607d5-host-slash\") pod \"iptables-alerter-xqcf6\" (UID: \"0f914685-9d69-4de0-9ff0-c7f5389607d5\") " pod="openshift-network-operator/iptables-alerter-xqcf6"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.711893    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-var-lib-openvswitch\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712055    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712115    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-run\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712159    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-systemd-units\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712233    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-registration-dir\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712302    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-conf-dir\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712337    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-cni-binary-copy\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712354    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-socket-dir-parent\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712397    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-host-cni-netd\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712409    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-hostroot\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712429    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-ovnkube-script-lib\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712453    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-multus-cni-dir\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.713235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712462    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-etc-kubernetes\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.714123 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712506    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f326744a-b5d2-478d-88a0-f2b4a3ee2774-host-var-lib-kubelet\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.714123 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712554    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f237f45-35f3-4d5f-b809-951798d6353e-etc-systemd\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.714123 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712572    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-etc-selinux\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.714123 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.712920    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f326744a-b5d2-478d-88a0-f2b4a3ee2774-cni-binary-copy\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.725665 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.725252    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg95d\" (UniqueName: \"kubernetes.io/projected/d09b0399-d94d-4fab-be6c-912f4fd178d0-kube-api-access-qg95d\") pod \"node-resolver-m4b6r\" (UID: \"d09b0399-d94d-4fab-be6c-912f4fd178d0\") " pod="openshift-dns/node-resolver-m4b6r"
Jul 15 14:30:42.726948 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.726878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnplx\" (UniqueName: \"kubernetes.io/projected/fc52b2ca-9a9e-4d2f-88fa-595422dccd93-kube-api-access-gnplx\") pod \"aws-ebs-csi-driver-node-74tdl\" (UID: \"fc52b2ca-9a9e-4d2f-88fa-595422dccd93\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.729049 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:42.728262    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:42.729049 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:42.728287    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:42.729049 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:42.728300    2574 projected.go:196] Error preparing data for projected volume kube-api-access-c6ftx for pod openshift-network-diagnostics/network-check-target-9swdm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:42.729049 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:42.728361    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx podName:a4d3a2e0-b568-46a0-bdd8-c80704c57326 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:43.228343356 +0000 UTC m=+3.121447705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ftx" (UniqueName: "kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx") pod "network-check-target-9swdm" (UID: "a4d3a2e0-b568-46a0-bdd8-c80704c57326") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:42.732345 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.732301    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l76s\" (UniqueName: \"kubernetes.io/projected/a4916d51-34b1-46b9-bd0b-fa0eeda5b548-kube-api-access-7l76s\") pod \"multus-additional-cni-plugins-gcgjm\" (UID: \"a4916d51-34b1-46b9-bd0b-fa0eeda5b548\") " pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.734811 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.734785    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8xj9\" (UniqueName: \"kubernetes.io/projected/0f914685-9d69-4de0-9ff0-c7f5389607d5-kube-api-access-s8xj9\") pod \"iptables-alerter-xqcf6\" (UID: \"0f914685-9d69-4de0-9ff0-c7f5389607d5\") " pod="openshift-network-operator/iptables-alerter-xqcf6"
Jul 15 14:30:42.735120 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.735095    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhz5f\" (UniqueName: \"kubernetes.io/projected/1f237f45-35f3-4d5f-b809-951798d6353e-kube-api-access-jhz5f\") pod \"tuned-x74x5\" (UID: \"1f237f45-35f3-4d5f-b809-951798d6353e\") " pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.737118 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.737091    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qprv9\" (UniqueName: \"kubernetes.io/projected/5dc6a39d-eb69-41d9-bd4e-618aed15ae01-kube-api-access-qprv9\") pod \"ovnkube-node-w9lj2\" (UID: \"5dc6a39d-eb69-41d9-bd4e-618aed15ae01\") " pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.738777 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.738728    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgd9n\" (UniqueName: \"kubernetes.io/projected/7960d43c-998b-486e-9138-e015127e6877-kube-api-access-mgd9n\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:42.741749 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.741705    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45shb\" (UniqueName: \"kubernetes.io/projected/f326744a-b5d2-478d-88a0-f2b4a3ee2774-kube-api-access-45shb\") pod \"multus-v5xbg\" (UID: \"f326744a-b5d2-478d-88a0-f2b4a3ee2774\") " pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.803432 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.803396    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9lhc5"
Jul 15 14:30:42.812460 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.812436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v5xbg"
Jul 15 14:30:42.821932 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.821905    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:30:42.834830 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.834780    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x74x5"
Jul 15 14:30:42.843636 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.843475    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xqcf6"
Jul 15 14:30:42.852724 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.852564    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gcgjm"
Jul 15 14:30:42.862160 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.862129    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:30:42.869571 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.869549    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl"
Jul 15 14:30:42.876280 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:42.876262    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m4b6r"
Jul 15 14:30:43.109806 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:43.109722    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:43.109981 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:43.109897    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:43.110047 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:43.109984    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret podName:87271241-2e0f-48e4-a296-7842b26dd134 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:44.109962373 +0000 UTC m=+4.003066724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret") pod "global-pull-secret-syncer-hr7xh" (UID: "87271241-2e0f-48e4-a296-7842b26dd134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:43.210763 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:43.210727    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:43.210948 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:43.210893    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:43.211000 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:43.210960    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs podName:7960d43c-998b-486e-9138-e015127e6877 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:44.210939952 +0000 UTC m=+4.104044301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs") pod "network-metrics-daemon-5qsjj" (UID: "7960d43c-998b-486e-9138-e015127e6877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:43.311273 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:43.311235    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ftx\" (UniqueName: \"kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx\") pod \"network-check-target-9swdm\" (UID: \"a4d3a2e0-b568-46a0-bdd8-c80704c57326\") " pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:43.311428 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:43.311407    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:43.311467 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:43.311429    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:43.311467 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:43.311440    2574 projected.go:196] Error preparing data for projected volume kube-api-access-c6ftx for pod openshift-network-diagnostics/network-check-target-9swdm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:43.311528 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:43.311494    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx podName:a4d3a2e0-b568-46a0-bdd8-c80704c57326 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:44.311479251 +0000 UTC m=+4.204583596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ftx" (UniqueName: "kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx") pod "network-check-target-9swdm" (UID: "a4d3a2e0-b568-46a0-bdd8-c80704c57326") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:43.629881 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:43.629836    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 14:25:42 +0000 UTC" deadline="2028-03-05 00:31:25.711378843 +0000 UTC"
Jul 15 14:30:43.629881 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:43.629876    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14362h0m42.081507883s"
Jul 15 14:30:43.646714 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:43.646690    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:43.646833 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:43.646789    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:30:43.704810 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:43.704783    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c22770_2f5a_40f0_b5cd_bcf852bf9109.slice/crio-381e9641e6983c1a2b0f5aae5654087a32d6137cc2cace45fbdf9508d5b7b908 WatchSource:0}: Error finding container 381e9641e6983c1a2b0f5aae5654087a32d6137cc2cace45fbdf9508d5b7b908: Status 404 returned error can't find the container with id 381e9641e6983c1a2b0f5aae5654087a32d6137cc2cace45fbdf9508d5b7b908
Jul 15 14:30:43.705649 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:43.705626    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4916d51_34b1_46b9_bd0b_fa0eeda5b548.slice/crio-4caa897a6d4561cbfe3b3598392a2f1db8326b6e3d1eebdb77013f9eb0255dd2 WatchSource:0}: Error finding container 4caa897a6d4561cbfe3b3598392a2f1db8326b6e3d1eebdb77013f9eb0255dd2: Status 404 returned error can't find the container with id 4caa897a6d4561cbfe3b3598392a2f1db8326b6e3d1eebdb77013f9eb0255dd2
Jul 15 14:30:43.706332 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:43.706312    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf326744a_b5d2_478d_88a0_f2b4a3ee2774.slice/crio-d3b23f6cd2a6cfd7b6a23b188e73c4a2090fef6d52fd1e8da3278c002e40e693 WatchSource:0}: Error finding container d3b23f6cd2a6cfd7b6a23b188e73c4a2090fef6d52fd1e8da3278c002e40e693: Status 404 returned error can't find the container with id d3b23f6cd2a6cfd7b6a23b188e73c4a2090fef6d52fd1e8da3278c002e40e693
Jul 15 14:30:43.710941 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:43.710922    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a27a6c6_2eee_49da_a95b_ce98f3d8418b.slice/crio-de8af742eb26042795e7b7771a67f9bbc41fc3f0e07d7250bc972fec70585ef9 WatchSource:0}: Error finding container de8af742eb26042795e7b7771a67f9bbc41fc3f0e07d7250bc972fec70585ef9: Status 404 returned error can't find the container with id de8af742eb26042795e7b7771a67f9bbc41fc3f0e07d7250bc972fec70585ef9
Jul 15 14:30:43.711900 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:43.711849    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc6a39d_eb69_41d9_bd4e_618aed15ae01.slice/crio-14e0773c87488a88719a0c8ba29d4bcd2ea9cb3482803d443667b9a00455d12b WatchSource:0}: Error finding container 14e0773c87488a88719a0c8ba29d4bcd2ea9cb3482803d443667b9a00455d12b: Status 404 returned error can't find the container with id 14e0773c87488a88719a0c8ba29d4bcd2ea9cb3482803d443667b9a00455d12b
Jul 15 14:30:43.713510 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:30:43.713488    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f914685_9d69_4de0_9ff0_c7f5389607d5.slice/crio-57efb89b25a354fbbb51196f44a418e431b2febc18bbe4a5ce286b8b7ea6ce0d WatchSource:0}: Error finding container 57efb89b25a354fbbb51196f44a418e431b2febc18bbe4a5ce286b8b7ea6ce0d: Status 404 returned error can't find the container with id 57efb89b25a354fbbb51196f44a418e431b2febc18bbe4a5ce286b8b7ea6ce0d
Jul 15 14:30:44.120598 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.120253    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:44.120598 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:44.120377    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:44.120818 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:44.120627    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret podName:87271241-2e0f-48e4-a296-7842b26dd134 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:46.120603681 +0000 UTC m=+6.013708027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret") pod "global-pull-secret-syncer-hr7xh" (UID: "87271241-2e0f-48e4-a296-7842b26dd134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:44.222791 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.221738    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:44.222791 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:44.221889    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:44.222791 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:44.221953    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs podName:7960d43c-998b-486e-9138-e015127e6877 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:46.221936775 +0000 UTC m=+6.115041122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs") pod "network-metrics-daemon-5qsjj" (UID: "7960d43c-998b-486e-9138-e015127e6877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:44.322490 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.322441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ftx\" (UniqueName: \"kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx\") pod \"network-check-target-9swdm\" (UID: \"a4d3a2e0-b568-46a0-bdd8-c80704c57326\") " pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:44.322710 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:44.322679    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:44.322775 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:44.322710    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:44.322775 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:44.322725    2574 projected.go:196] Error preparing data for projected volume kube-api-access-c6ftx for pod openshift-network-diagnostics/network-check-target-9swdm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:44.322884 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:44.322797    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx podName:a4d3a2e0-b568-46a0-bdd8-c80704c57326 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:46.322777005 +0000 UTC m=+6.215881372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ftx" (UniqueName: "kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx") pod "network-check-target-9swdm" (UID: "a4d3a2e0-b568-46a0-bdd8-c80704c57326") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:44.347736 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.347703    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:30:44.631044 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.630948    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 14:25:42 +0000 UTC" deadline="2028-04-10 13:03:41.0996513 +0000 UTC"
Jul 15 14:30:44.631044 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.631010    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15238h32m56.46864606s"
Jul 15 14:30:44.650519 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.649819    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:44.650519 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.649836    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:44.650519 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:44.649975    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:30:44.650519 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:44.650149    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:30:44.666254 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.666180    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9lhc5" event={"ID":"55c22770-2f5a-40f0-b5cd-bcf852bf9109","Type":"ContainerStarted","Data":"381e9641e6983c1a2b0f5aae5654087a32d6137cc2cace45fbdf9508d5b7b908"}
Jul 15 14:30:44.669592 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.669560    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal" event={"ID":"c0da50a7d7df95402dc3e08da9587549","Type":"ContainerStarted","Data":"dcbb0360c51191047452e5c8ac25b637b99be6f123f475f7668777ed3b0064c5"}
Jul 15 14:30:44.672384 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.672359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x74x5" event={"ID":"1f237f45-35f3-4d5f-b809-951798d6353e","Type":"ContainerStarted","Data":"8c48ba973248e286e8d68a7e4c322752457ca72643702fcd8cca71a87ea38232"}
Jul 15 14:30:44.680094 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.680010    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl" event={"ID":"fc52b2ca-9a9e-4d2f-88fa-595422dccd93","Type":"ContainerStarted","Data":"a816b7bf39673749f398b7d2e02dff8363a66f710f38f5aa4d6e6469f47f47b2"}
Jul 15 14:30:44.685389 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.685285    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2" event={"ID":"5dc6a39d-eb69-41d9-bd4e-618aed15ae01","Type":"ContainerStarted","Data":"14e0773c87488a88719a0c8ba29d4bcd2ea9cb3482803d443667b9a00455d12b"}
Jul 15 14:30:44.689236 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.688731    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-118.ec2.internal" podStartSLOduration=2.6887138 podStartE2EDuration="2.6887138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:30:44.688586561 +0000 UTC m=+4.581690929" watchObservedRunningTime="2026-07-15 14:30:44.6887138 +0000 UTC m=+4.581818166"
Jul 15 14:30:44.689353 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.689313    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-425hb" event={"ID":"4a27a6c6-2eee-49da-a95b-ce98f3d8418b","Type":"ContainerStarted","Data":"de8af742eb26042795e7b7771a67f9bbc41fc3f0e07d7250bc972fec70585ef9"}
Jul 15 14:30:44.693295 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.693268    2574 generic.go:356] "Generic (PLEG): container finished" podID="ad6ad4f2ac9840233e2a86ee45c101a4" containerID="2db96f88c0bcb64cf727e0f68a107573ae3c02b54539c3d03e4145aaba45fd6f" exitCode=0
Jul 15 14:30:44.693395 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.693350    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal" event={"ID":"ad6ad4f2ac9840233e2a86ee45c101a4","Type":"ContainerDied","Data":"2db96f88c0bcb64cf727e0f68a107573ae3c02b54539c3d03e4145aaba45fd6f"}
Jul 15 14:30:44.700019 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.699775    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m4b6r" event={"ID":"d09b0399-d94d-4fab-be6c-912f4fd178d0","Type":"ContainerStarted","Data":"2df0a351d22f62f18530dcb80bff910f371d9bb17c5266e14638f6df5870bc02"}
Jul 15 14:30:44.702680 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.702652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xqcf6" event={"ID":"0f914685-9d69-4de0-9ff0-c7f5389607d5","Type":"ContainerStarted","Data":"57efb89b25a354fbbb51196f44a418e431b2febc18bbe4a5ce286b8b7ea6ce0d"}
Jul 15 14:30:44.710362 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.710290    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v5xbg" event={"ID":"f326744a-b5d2-478d-88a0-f2b4a3ee2774","Type":"ContainerStarted","Data":"d3b23f6cd2a6cfd7b6a23b188e73c4a2090fef6d52fd1e8da3278c002e40e693"}
Jul 15 14:30:44.717275 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:44.717190    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcgjm" event={"ID":"a4916d51-34b1-46b9-bd0b-fa0eeda5b548","Type":"ContainerStarted","Data":"4caa897a6d4561cbfe3b3598392a2f1db8326b6e3d1eebdb77013f9eb0255dd2"}
Jul 15 14:30:45.647279 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:45.646935    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:45.647279 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:45.647111    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:30:45.760427 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:45.760319    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal" event={"ID":"ad6ad4f2ac9840233e2a86ee45c101a4","Type":"ContainerStarted","Data":"ca0ce40e15691dffc4767e9ea5457c59b199d29269de5ad8f0ba6e55205500bc"}
Jul 15 14:30:46.140663 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:46.140623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:46.140878 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:46.140823    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:46.140941 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:46.140891    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret podName:87271241-2e0f-48e4-a296-7842b26dd134 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:50.140871908 +0000 UTC m=+10.033976258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret") pod "global-pull-secret-syncer-hr7xh" (UID: "87271241-2e0f-48e4-a296-7842b26dd134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:46.241730 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:46.241691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:46.241903 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:46.241858    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:46.241956 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:46.241922    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs podName:7960d43c-998b-486e-9138-e015127e6877 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:50.241903585 +0000 UTC m=+10.135007936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs") pod "network-metrics-daemon-5qsjj" (UID: "7960d43c-998b-486e-9138-e015127e6877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:46.342689 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:46.342647    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ftx\" (UniqueName: \"kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx\") pod \"network-check-target-9swdm\" (UID: \"a4d3a2e0-b568-46a0-bdd8-c80704c57326\") " pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:46.342889 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:46.342867    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:46.342976 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:46.342896    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:46.342976 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:46.342909    2574 projected.go:196] Error preparing data for projected volume kube-api-access-c6ftx for pod openshift-network-diagnostics/network-check-target-9swdm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:46.342976 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:46.342971    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx podName:a4d3a2e0-b568-46a0-bdd8-c80704c57326 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:50.342950816 +0000 UTC m=+10.236055166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ftx" (UniqueName: "kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx") pod "network-check-target-9swdm" (UID: "a4d3a2e0-b568-46a0-bdd8-c80704c57326") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:46.647327 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:46.647283    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:46.647752 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:46.647411    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:30:46.649651 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:46.649625    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:46.649775 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:46.649748    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:30:47.647213 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:47.646718    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:47.647213 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:47.646844    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:30:48.647321 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:48.647235    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:48.647488 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:48.647378    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:30:48.647872 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:48.647851    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:48.647992 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:48.647968    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:30:49.647175 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:49.647143    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:49.647355 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:49.647313    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:30:50.180741 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:50.180687    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:50.181251 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:50.180794    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:50.181251 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:50.180869    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret podName:87271241-2e0f-48e4-a296-7842b26dd134 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:58.180850628 +0000 UTC m=+18.073954972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret") pod "global-pull-secret-syncer-hr7xh" (UID: "87271241-2e0f-48e4-a296-7842b26dd134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:50.281826 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:50.281788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:50.281989 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:50.281943    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:50.282043 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:50.282020    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs podName:7960d43c-998b-486e-9138-e015127e6877 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:58.282000813 +0000 UTC m=+18.175105167 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs") pod "network-metrics-daemon-5qsjj" (UID: "7960d43c-998b-486e-9138-e015127e6877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:50.383020 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:50.382982    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ftx\" (UniqueName: \"kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx\") pod \"network-check-target-9swdm\" (UID: \"a4d3a2e0-b568-46a0-bdd8-c80704c57326\") " pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:50.383220 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:50.383187    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:50.383220 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:50.383213    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:50.383307 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:50.383226    2574 projected.go:196] Error preparing data for projected volume kube-api-access-c6ftx for pod openshift-network-diagnostics/network-check-target-9swdm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:50.383307 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:50.383289    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx podName:a4d3a2e0-b568-46a0-bdd8-c80704c57326 nodeName:}" failed. No retries permitted until 2026-07-15 14:30:58.38327076 +0000 UTC m=+18.276375108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ftx" (UniqueName: "kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx") pod "network-check-target-9swdm" (UID: "a4d3a2e0-b568-46a0-bdd8-c80704c57326") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:50.648095 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:50.647991    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:50.649080 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:50.649025    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:50.649255 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:50.649195    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:30:50.649333 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:50.649308    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:30:51.647686 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:51.647264    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:51.647686 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:51.647409    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:30:52.649291 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:52.648895    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:52.649291 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:52.649055    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:30:52.649291 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:52.649127    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:52.649291 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:52.649232    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:30:53.646857 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:53.646821    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:53.647035 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:53.646958    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:30:54.647005 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:54.646971    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:54.647005 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:54.646984    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:54.647512 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:54.647096    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:30:54.647512 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:54.647220    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:30:55.647272 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:55.647236    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:55.647744 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:55.647360    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:30:56.646360 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:56.646311    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:56.646525 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:56.646467    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:30:56.646600 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:56.646524    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:56.646650 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:56.646632    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:30:57.646535 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:57.646501    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:57.647057 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:57.646610    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:30:58.249331 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:58.249292    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:58.249499 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:58.249476    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:58.249553 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:58.249539    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret podName:87271241-2e0f-48e4-a296-7842b26dd134 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:14.249525093 +0000 UTC m=+34.142629436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret") pod "global-pull-secret-syncer-hr7xh" (UID: "87271241-2e0f-48e4-a296-7842b26dd134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:30:58.350638 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:58.350602    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:58.350796 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:58.350746    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:58.350838 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:58.350804    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs podName:7960d43c-998b-486e-9138-e015127e6877 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:14.350788895 +0000 UTC m=+34.243893239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs") pod "network-metrics-daemon-5qsjj" (UID: "7960d43c-998b-486e-9138-e015127e6877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:30:58.451686 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:58.451653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ftx\" (UniqueName: \"kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx\") pod \"network-check-target-9swdm\" (UID: \"a4d3a2e0-b568-46a0-bdd8-c80704c57326\") " pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:58.451865 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:58.451833    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:30:58.451865 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:58.451858    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:30:58.451973 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:58.451870    2574 projected.go:196] Error preparing data for projected volume kube-api-access-c6ftx for pod openshift-network-diagnostics/network-check-target-9swdm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:58.451973 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:58.451937    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx podName:a4d3a2e0-b568-46a0-bdd8-c80704c57326 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:14.45191677 +0000 UTC m=+34.345021128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ftx" (UniqueName: "kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx") pod "network-check-target-9swdm" (UID: "a4d3a2e0-b568-46a0-bdd8-c80704c57326") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:30:58.649978 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:58.649952    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:30:58.650381 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:58.650091    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:30:58.650381 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:58.650157    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:30:58.650381 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:58.650253    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:30:59.647077 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:30:59.647045    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:30:59.647256 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:30:59.647178    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:31:00.647936 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:00.647901    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:00.648432 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:00.648014    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:31:00.648432 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:00.648083    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:00.648432 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:00.648222    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:31:01.646923 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:01.646887    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:01.647116 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:01.647013    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:31:02.647493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.647462    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:02.647831 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:02.647626    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:31:02.648048 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.648026    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:02.648210 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:02.648150    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:31:02.800872 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.800658    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x74x5" event={"ID":"1f237f45-35f3-4d5f-b809-951798d6353e","Type":"ContainerStarted","Data":"2524ccc57bdb4ede851a32eac210a8a89346c5256d7d067159b7dfc96869dd04"}
Jul 15 14:31:02.802270 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.802238    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl" event={"ID":"fc52b2ca-9a9e-4d2f-88fa-595422dccd93","Type":"ContainerStarted","Data":"a556e0b4048242df45ed116d968d63bee3ce3c52949362b0031a570e2c1bb3df"}
Jul 15 14:31:02.804004 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.803838    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2" event={"ID":"5dc6a39d-eb69-41d9-bd4e-618aed15ae01","Type":"ContainerStarted","Data":"3fd7627bf278d6bd01049b108c3a47faaf0653801ed4bed587418c1a35876d28"}
Jul 15 14:31:02.805520 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.805499    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-425hb" event={"ID":"4a27a6c6-2eee-49da-a95b-ce98f3d8418b","Type":"ContainerStarted","Data":"0c2ea5f1e5518d488f24b8f26b9f518998e88bb630823fdcb96e122f8681fd71"}
Jul 15 14:31:02.807293 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.806935    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m4b6r" event={"ID":"d09b0399-d94d-4fab-be6c-912f4fd178d0","Type":"ContainerStarted","Data":"8bc6bb024991006c9a24652d28378e4a17b2fcc87ec1c4fbdca47ddbcf4ca5d1"}
Jul 15 14:31:02.808686 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.808666    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v5xbg" event={"ID":"f326744a-b5d2-478d-88a0-f2b4a3ee2774","Type":"ContainerStarted","Data":"a7ade1130e7fdef94809cbcb5f6884bafffe61d1e5caa5f8ab27be298d6f2de2"}
Jul 15 14:31:02.810209 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.810188    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcgjm" event={"ID":"a4916d51-34b1-46b9-bd0b-fa0eeda5b548","Type":"ContainerStarted","Data":"d5538c3c15a932102679f3b1f820cb38b032198d0374233f263a3e33276eeda6"}
Jul 15 14:31:02.812658 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.812634    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9lhc5" event={"ID":"55c22770-2f5a-40f0-b5cd-bcf852bf9109","Type":"ContainerStarted","Data":"09e18a39ea60fb6185bd5142ceebe8e7e08b2c048ba88086535c5c4b4e2c4990"}
Jul 15 14:31:02.821065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.821019    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x74x5" podStartSLOduration=2.967557897 podStartE2EDuration="21.821002236s" totalImagesPullingTime="18.853444339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:02.820594514 +0000 UTC m=+22.713698879" watchObservedRunningTime="2026-07-15 14:31:02.821002236 +0000 UTC m=+22.714106601"
Jul 15 14:31:02.821457 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.821418    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-118.ec2.internal" podStartSLOduration=20.821401935 podStartE2EDuration="20.821401935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:30:45.780478823 +0000 UTC m=+5.673583195" watchObservedRunningTime="2026-07-15 14:31:02.821401935 +0000 UTC m=+22.714506325"
Jul 15 14:31:02.870900 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.870730    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-425hb" podStartSLOduration=6.691415593 podStartE2EDuration="21.870712929s" totalImagesPullingTime="15.179297336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:02.870458851 +0000 UTC m=+22.763563216" watchObservedRunningTime="2026-07-15 14:31:02.870712929 +0000 UTC m=+22.763817294"
Jul 15 14:31:02.903597 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.903551    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m4b6r" podStartSLOduration=3.074491449 podStartE2EDuration="21.903534547s" totalImagesPullingTime="18.829043098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:02.88674068 +0000 UTC m=+22.779845046" watchObservedRunningTime="2026-07-15 14:31:02.903534547 +0000 UTC m=+22.796638912"
Jul 15 14:31:02.903685 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.903627    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9lhc5" podStartSLOduration=3.058905431 podStartE2EDuration="21.903621431s" totalImagesPullingTime="18.844716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:02.903441321 +0000 UTC m=+22.796545687" watchObservedRunningTime="2026-07-15 14:31:02.903621431 +0000 UTC m=+22.796725796"
Jul 15 14:31:02.922738 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:02.922688    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v5xbg" podStartSLOduration=3.033468212 podStartE2EDuration="21.922666768s" totalImagesPullingTime="18.889198556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:02.922084357 +0000 UTC m=+22.815188723" watchObservedRunningTime="2026-07-15 14:31:02.922666768 +0000 UTC m=+22.815771134"
Jul 15 14:31:03.646858 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:03.646345    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:03.646858 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:03.646471    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:31:03.817598 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:03.817564    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2" event={"ID":"5dc6a39d-eb69-41d9-bd4e-618aed15ae01","Type":"ContainerStarted","Data":"8e942c413528e12d3b1b25c930f374a7a72abdc5600f30ffd621b8f11f96b5b0"}
Jul 15 14:31:03.818409 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:03.817635    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2" event={"ID":"5dc6a39d-eb69-41d9-bd4e-618aed15ae01","Type":"ContainerStarted","Data":"53099a4e33e45280de1c4a5b81a5134e91fc8a1ade970179eac070a99ba3a3ab"}
Jul 15 14:31:03.818409 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:03.817665    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2" event={"ID":"5dc6a39d-eb69-41d9-bd4e-618aed15ae01","Type":"ContainerStarted","Data":"38c3cec3cfc2d7b38371c0ce523a6aeaced1452e0a6c86dbd805c5d5bd2485e4"}
Jul 15 14:31:03.818409 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:03.817694    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2" event={"ID":"5dc6a39d-eb69-41d9-bd4e-618aed15ae01","Type":"ContainerStarted","Data":"9bb4575783121ae0f67636499b4f84384ca280df3608b44f2a341db34704dec0"}
Jul 15 14:31:03.818409 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:03.817721    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2" event={"ID":"5dc6a39d-eb69-41d9-bd4e-618aed15ae01","Type":"ContainerStarted","Data":"59e9eab9aae4863fb15f663caca3a203ff6bee29cb3a3fb7ac57198da9c95c67"}
Jul 15 14:31:03.818930 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:03.818903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xqcf6" event={"ID":"0f914685-9d69-4de0-9ff0-c7f5389607d5","Type":"ContainerStarted","Data":"a2ec89a6765851aa04c21029c23ff620d324daf843594a40f2ae828c567af506"}
Jul 15 14:31:03.820126 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:03.820103    2574 generic.go:356] "Generic (PLEG): container finished" podID="a4916d51-34b1-46b9-bd0b-fa0eeda5b548" containerID="d5538c3c15a932102679f3b1f820cb38b032198d0374233f263a3e33276eeda6" exitCode=0
Jul 15 14:31:03.820231 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:03.820190    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcgjm" event={"ID":"a4916d51-34b1-46b9-bd0b-fa0eeda5b548","Type":"ContainerDied","Data":"d5538c3c15a932102679f3b1f820cb38b032198d0374233f263a3e33276eeda6"}
Jul 15 14:31:03.857927 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:03.857838    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xqcf6" podStartSLOduration=4.021724158 podStartE2EDuration="22.857823861s" totalImagesPullingTime="18.836099703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:03.835935836 +0000 UTC m=+23.729040283" watchObservedRunningTime="2026-07-15 14:31:03.857823861 +0000 UTC m=+23.750928227"
Jul 15 14:31:04.218641 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:04.218613    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 14:31:04.566894 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:04.566802    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T14:31:04.218631624Z","UUID":"497cb2ae-69b9-4069-a021-e524b13c3e89","Handler":null,"Name":"","Endpoint":""}
Jul 15 14:31:04.568187 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:04.568168    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 14:31:04.568291 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:04.568203    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 14:31:04.650326 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:04.650289    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:04.650488 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:04.650290    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:04.650488 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:04.650409    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:31:04.650569 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:04.650502    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:31:04.824126 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:04.824037    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl" event={"ID":"fc52b2ca-9a9e-4d2f-88fa-595422dccd93","Type":"ContainerStarted","Data":"5b06049e1bdb9d3d5255e220f0c8528fb12f1efada164ce062ab62e3ed2ab824"}
Jul 15 14:31:05.248289 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:05.248255    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:31:05.248868 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:05.248848    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:31:05.646464 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:05.646294    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:05.646604 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:05.646533    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:31:05.829044 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:05.828963    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl" event={"ID":"fc52b2ca-9a9e-4d2f-88fa-595422dccd93","Type":"ContainerStarted","Data":"8eb6ab5e79d52d4690ea8c4e0be60674359a9fc4bb8bf46744e43d81903a0201"}
Jul 15 14:31:05.832849 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:05.832817    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2" event={"ID":"5dc6a39d-eb69-41d9-bd4e-618aed15ae01","Type":"ContainerStarted","Data":"94103d9c396ec07d75e8d70bb1b945565203a099c97d2e756726901404513a7f"}
Jul 15 14:31:05.832987 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:05.832894    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:31:05.833519 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:05.833497    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-425hb"
Jul 15 14:31:05.853607 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:05.853560    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-74tdl" podStartSLOduration=3.512635785 podStartE2EDuration="24.853546454s" totalImagesPullingTime="21.340910669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:05.853242104 +0000 UTC m=+25.746346470" watchObservedRunningTime="2026-07-15 14:31:05.853546454 +0000 UTC m=+25.746650820"
Jul 15 14:31:06.647114 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:06.647085    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:06.647353 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:06.647232    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:31:06.647353 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:06.647286    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:06.647477 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:06.647377    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:31:07.647158 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:07.646595    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:07.647158 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:07.646704    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:31:08.647144 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:08.647036    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:08.647307 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:08.647193    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:31:08.647307 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:08.647282    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:08.647725 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:08.647398    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:31:09.647185 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:09.647011    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:09.647278 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:09.647264    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:31:09.846020 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:09.845936    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2" event={"ID":"5dc6a39d-eb69-41d9-bd4e-618aed15ae01","Type":"ContainerStarted","Data":"0ddaea83d932fbff1feaad5cbf1fbf9f997bc03e08332ab904e9b06d91743bbf"}
Jul 15 14:31:09.846596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:09.846194    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:31:09.846596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:09.846261    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:31:09.846596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:09.846308    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:31:09.847977 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:09.847950    2574 generic.go:356] "Generic (PLEG): container finished" podID="a4916d51-34b1-46b9-bd0b-fa0eeda5b548" containerID="58be9cd2608353b3c7aa93b247366f99493bb04cd25b237f45e3b6208f47f27d" exitCode=0
Jul 15 14:31:09.848309 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:09.847985    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcgjm" event={"ID":"a4916d51-34b1-46b9-bd0b-fa0eeda5b548","Type":"ContainerDied","Data":"58be9cd2608353b3c7aa93b247366f99493bb04cd25b237f45e3b6208f47f27d"}
Jul 15 14:31:09.861873 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:09.861846    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:31:09.862006 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:09.861991    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:31:09.873562 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:09.873518    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2" podStartSLOduration=9.959845388 podStartE2EDuration="28.873502179s" totalImagesPullingTime="18.913656791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:09.873370638 +0000 UTC m=+29.766475003" watchObservedRunningTime="2026-07-15 14:31:09.873502179 +0000 UTC m=+29.766606545"
Jul 15 14:31:10.648435 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:10.648405    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:10.648900 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:10.648487    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:10.648900 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:10.648511    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:31:10.648900 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:10.648605    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:31:11.202776 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:11.202538    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hr7xh"]
Jul 15 14:31:11.203159 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:11.202778    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:11.203159 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:11.202868    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:31:11.205549 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:11.205520    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9swdm"]
Jul 15 14:31:11.205659 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:11.205610    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:11.205699 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:11.205677    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:31:11.208981 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:11.208952    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5qsjj"]
Jul 15 14:31:11.209105 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:11.209047    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:11.209207 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:11.209176    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:31:11.855253 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:11.855216    2574 generic.go:356] "Generic (PLEG): container finished" podID="a4916d51-34b1-46b9-bd0b-fa0eeda5b548" containerID="1f9b11c6b2a3c59817c9068b0f6ddce095fcddbdde63862b002dfc3dfddbf453" exitCode=0
Jul 15 14:31:11.855406 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:11.855307    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcgjm" event={"ID":"a4916d51-34b1-46b9-bd0b-fa0eeda5b548","Type":"ContainerDied","Data":"1f9b11c6b2a3c59817c9068b0f6ddce095fcddbdde63862b002dfc3dfddbf453"}
Jul 15 14:31:12.647078 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:12.646987    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:12.647488 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:12.646986    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:12.647488 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:12.647099    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:31:12.647488 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:12.647209    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:31:12.647488 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:12.647237    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:12.647488 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:12.647298    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:31:14.272014 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:14.271977    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:14.272491 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:14.272081    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:31:14.272491 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:14.272145    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret podName:87271241-2e0f-48e4-a296-7842b26dd134 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:46.272115327 +0000 UTC m=+66.165219670 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret") pod "global-pull-secret-syncer-hr7xh" (UID: "87271241-2e0f-48e4-a296-7842b26dd134") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:31:14.372420 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:14.372384    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:14.372599 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:14.372494    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:31:14.372599 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:14.372564    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs podName:7960d43c-998b-486e-9138-e015127e6877 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:46.372545352 +0000 UTC m=+66.265649696 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs") pod "network-metrics-daemon-5qsjj" (UID: "7960d43c-998b-486e-9138-e015127e6877") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:31:14.473568 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:14.473484    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ftx\" (UniqueName: \"kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx\") pod \"network-check-target-9swdm\" (UID: \"a4d3a2e0-b568-46a0-bdd8-c80704c57326\") " pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:14.473750 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:14.473690    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:31:14.473750 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:14.473716    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:31:14.473750 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:14.473728    2574 projected.go:196] Error preparing data for projected volume kube-api-access-c6ftx for pod openshift-network-diagnostics/network-check-target-9swdm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:31:14.473899 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:14.473789    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx podName:a4d3a2e0-b568-46a0-bdd8-c80704c57326 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:46.47377003 +0000 UTC m=+66.366874381 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6ftx" (UniqueName: "kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx") pod "network-check-target-9swdm" (UID: "a4d3a2e0-b568-46a0-bdd8-c80704c57326") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:31:14.646680 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:14.646653    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:14.646680 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:14.646672    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:14.646983 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:14.646653    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:14.646983 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:14.646762    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hr7xh" podUID="87271241-2e0f-48e4-a296-7842b26dd134"
Jul 15 14:31:14.646983 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:14.646838    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9swdm" podUID="a4d3a2e0-b568-46a0-bdd8-c80704c57326"
Jul 15 14:31:14.646983 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:14.646884    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5qsjj" podUID="7960d43c-998b-486e-9138-e015127e6877"
Jul 15 14:31:14.864053 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:14.863982    2574 generic.go:356] "Generic (PLEG): container finished" podID="a4916d51-34b1-46b9-bd0b-fa0eeda5b548" containerID="e87181a741c735e7f3cce6a298922222cc88ce283a2110759de15e4e97aff4e5" exitCode=0
Jul 15 14:31:14.864053 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:14.864030    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcgjm" event={"ID":"a4916d51-34b1-46b9-bd0b-fa0eeda5b548","Type":"ContainerDied","Data":"e87181a741c735e7f3cce6a298922222cc88ce283a2110759de15e4e97aff4e5"}
Jul 15 14:31:15.355156 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.355114    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-118.ec2.internal" event="NodeReady"
Jul 15 14:31:15.355673 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.355276    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 14:31:15.393259 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.393227    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6875b777db-qxrk2"]
Jul 15 14:31:15.395140 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.395118    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.398399 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.398379    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 14:31:15.398613 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.398596    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 14:31:15.398827 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.398809    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 14:31:15.398925 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.398837    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z6j7k\""
Jul 15 14:31:15.408286 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.408264    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 14:31:15.413749 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.413726    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rwh8s"]
Jul 15 14:31:15.415707 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.415693    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.418118 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.418091    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 14:31:15.418118 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.418107    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 14:31:15.418266 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.418163    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ns9wp\""
Jul 15 14:31:15.423181 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.423162    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z9lt8"]
Jul 15 14:31:15.424910 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.424892    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6875b777db-qxrk2"]
Jul 15 14:31:15.425002 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.424981    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z9lt8"
Jul 15 14:31:15.427575 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.427551    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 14:31:15.427673 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.427578    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 14:31:15.427673 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.427553    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 14:31:15.427673 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.427551    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z26g2\""
Jul 15 14:31:15.430321 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.430301    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rwh8s"]
Jul 15 14:31:15.434630 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.434614    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z9lt8"]
Jul 15 14:31:15.582407 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582359    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-ca-trust-extracted\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.582407 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-trusted-ca\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.582407 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582420    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g7dd\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-kube-api-access-2g7dd\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.582659 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c4f431a-01f0-4d42-a5e9-956bd037771e-cert\") pod \"ingress-canary-z9lt8\" (UID: \"7c4f431a-01f0-4d42-a5e9-956bd037771e\") " pod="openshift-ingress-canary/ingress-canary-z9lt8"
Jul 15 14:31:15.582659 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582453    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-image-registry-private-configuration\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.582659 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582470    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-config-volume\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.582659 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582489    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm228\" (UniqueName: \"kubernetes.io/projected/7c4f431a-01f0-4d42-a5e9-956bd037771e-kube-api-access-wm228\") pod \"ingress-canary-z9lt8\" (UID: \"7c4f431a-01f0-4d42-a5e9-956bd037771e\") " pod="openshift-ingress-canary/ingress-canary-z9lt8"
Jul 15 14:31:15.582659 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582573    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.582659 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582607    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-bound-sa-token\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.582659 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582623    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.582659 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582650    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-tmp-dir\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.582898 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582663    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-856fs\" (UniqueName: \"kubernetes.io/projected/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-kube-api-access-856fs\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.582898 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582710    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-certificates\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.582898 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.582728    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-installation-pull-secrets\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.683438 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-tmp-dir\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.683619 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683446    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-856fs\" (UniqueName: \"kubernetes.io/projected/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-kube-api-access-856fs\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.683687 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683645    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-certificates\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.683687 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683674    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-installation-pull-secrets\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.683800 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683781    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-tmp-dir\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.683841 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-ca-trust-extracted\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.683841 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683830    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-trusted-ca\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.683933 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683848    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g7dd\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-kube-api-access-2g7dd\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.683933 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683865    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c4f431a-01f0-4d42-a5e9-956bd037771e-cert\") pod \"ingress-canary-z9lt8\" (UID: \"7c4f431a-01f0-4d42-a5e9-956bd037771e\") " pod="openshift-ingress-canary/ingress-canary-z9lt8"
Jul 15 14:31:15.683933 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-image-registry-private-configuration\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.683933 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-config-volume\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.683933 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683922    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm228\" (UniqueName: \"kubernetes.io/projected/7c4f431a-01f0-4d42-a5e9-956bd037771e-kube-api-access-wm228\") pod \"ingress-canary-z9lt8\" (UID: \"7c4f431a-01f0-4d42-a5e9-956bd037771e\") " pod="openshift-ingress-canary/ingress-canary-z9lt8"
Jul 15 14:31:15.684212 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.683980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.684212 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.684011    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-bound-sa-token\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.684212 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.684033    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.684212 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.684105    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-ca-trust-extracted\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.684212 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:15.684178    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:15.684435 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:15.684239    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls podName:ce4d862f-aeea-4d7e-a38e-bbd2ea25a233 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:16.184222166 +0000 UTC m=+36.077326510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls") pod "dns-default-rwh8s" (UID: "ce4d862f-aeea-4d7e-a38e-bbd2ea25a233") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:15.684435 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.684286    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-certificates\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.684435 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:15.684300    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:15.684435 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:15.684310    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6875b777db-qxrk2: secret "image-registry-tls" not found
Jul 15 14:31:15.684435 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:15.684335    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls podName:3cfbf9a0-89ec-410f-9216-611b7c74a7ea nodeName:}" failed. No retries permitted until 2026-07-15 14:31:16.184326943 +0000 UTC m=+36.077431286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls") pod "image-registry-6875b777db-qxrk2" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea") : secret "image-registry-tls" not found
Jul 15 14:31:15.684778 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.684758    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-config-volume\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.684840 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.684789    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-trusted-ca\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.687885 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.687860    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c4f431a-01f0-4d42-a5e9-956bd037771e-cert\") pod \"ingress-canary-z9lt8\" (UID: \"7c4f431a-01f0-4d42-a5e9-956bd037771e\") " pod="openshift-ingress-canary/ingress-canary-z9lt8"
Jul 15 14:31:15.687885 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.687876    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-installation-pull-secrets\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.688012 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.687876    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-image-registry-private-configuration\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.693708 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.693684    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g7dd\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-kube-api-access-2g7dd\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.693933 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.693916    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm228\" (UniqueName: \"kubernetes.io/projected/7c4f431a-01f0-4d42-a5e9-956bd037771e-kube-api-access-wm228\") pod \"ingress-canary-z9lt8\" (UID: \"7c4f431a-01f0-4d42-a5e9-956bd037771e\") " pod="openshift-ingress-canary/ingress-canary-z9lt8"
Jul 15 14:31:15.695167 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.695148    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-bound-sa-token\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:15.695363 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.695347    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-856fs\" (UniqueName: \"kubernetes.io/projected/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-kube-api-access-856fs\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:15.733576 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.733551    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z9lt8"
Jul 15 14:31:15.866006 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:15.865780    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z9lt8"]
Jul 15 14:31:15.869106 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:31:15.869073    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4f431a_01f0_4d42_a5e9_956bd037771e.slice/crio-6c76ccd118c7e8d073f7a52ad21286d553ba06b4e850b419b5eb8aebe6dd3b1d WatchSource:0}: Error finding container 6c76ccd118c7e8d073f7a52ad21286d553ba06b4e850b419b5eb8aebe6dd3b1d: Status 404 returned error can't find the container with id 6c76ccd118c7e8d073f7a52ad21286d553ba06b4e850b419b5eb8aebe6dd3b1d
Jul 15 14:31:16.186680 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.186646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:16.186868 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.186761    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:16.186868 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:16.186808    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:16.186868 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:16.186861    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:16.187011 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:16.186874    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6875b777db-qxrk2: secret "image-registry-tls" not found
Jul 15 14:31:16.187011 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:16.186902    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls podName:ce4d862f-aeea-4d7e-a38e-bbd2ea25a233 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:17.186881196 +0000 UTC m=+37.079985560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls") pod "dns-default-rwh8s" (UID: "ce4d862f-aeea-4d7e-a38e-bbd2ea25a233") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:16.187011 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:16.186923    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls podName:3cfbf9a0-89ec-410f-9216-611b7c74a7ea nodeName:}" failed. No retries permitted until 2026-07-15 14:31:17.186913957 +0000 UTC m=+37.080018303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls") pod "image-registry-6875b777db-qxrk2" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea") : secret "image-registry-tls" not found
Jul 15 14:31:16.647471 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.647396    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:16.648042 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.648023    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:16.648171 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.648023    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:16.650593 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.650544    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 14:31:16.652064 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.651823    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 14:31:16.652064 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.651823    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cj2n5\""
Jul 15 14:31:16.652064 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.651899    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 14:31:16.652064 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.651945    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cqtkh\""
Jul 15 14:31:16.652382 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.652120    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 14:31:16.870379 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:16.870333    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z9lt8" event={"ID":"7c4f431a-01f0-4d42-a5e9-956bd037771e","Type":"ContainerStarted","Data":"6c76ccd118c7e8d073f7a52ad21286d553ba06b4e850b419b5eb8aebe6dd3b1d"}
Jul 15 14:31:17.201946 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:17.201904    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:17.202160 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:17.201959    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:17.202160 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:17.202070    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:17.202160 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:17.202088    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6875b777db-qxrk2: secret "image-registry-tls" not found
Jul 15 14:31:17.202160 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:17.202094    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:17.202336 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:17.202171    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls podName:3cfbf9a0-89ec-410f-9216-611b7c74a7ea nodeName:}" failed. No retries permitted until 2026-07-15 14:31:19.202143396 +0000 UTC m=+39.095247754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls") pod "image-registry-6875b777db-qxrk2" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea") : secret "image-registry-tls" not found
Jul 15 14:31:17.202336 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:17.202191    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls podName:ce4d862f-aeea-4d7e-a38e-bbd2ea25a233 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:19.202182365 +0000 UTC m=+39.095286713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls") pod "dns-default-rwh8s" (UID: "ce4d862f-aeea-4d7e-a38e-bbd2ea25a233") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:18.374554 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:18.374523    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:18.481249 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:18.481196    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:19.216553 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:19.216517    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:19.216738 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:19.216560    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:19.216738 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:19.216664    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:19.216738 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:19.216678    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:19.216738 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:19.216702    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6875b777db-qxrk2: secret "image-registry-tls" not found
Jul 15 14:31:19.216738 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:19.216728    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls podName:ce4d862f-aeea-4d7e-a38e-bbd2ea25a233 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:23.216708099 +0000 UTC m=+43.109812469 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls") pod "dns-default-rwh8s" (UID: "ce4d862f-aeea-4d7e-a38e-bbd2ea25a233") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:19.216991 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:19.216754    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls podName:3cfbf9a0-89ec-410f-9216-611b7c74a7ea nodeName:}" failed. No retries permitted until 2026-07-15 14:31:23.216736126 +0000 UTC m=+43.109840472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls") pod "image-registry-6875b777db-qxrk2" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea") : secret "image-registry-tls" not found
Jul 15 14:31:19.741466 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:19.741424    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:19.849322 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:19.849291    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:19.946376 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:19.946333    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:20.354865 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:20.354838    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:20.449174 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:20.449102    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:20.556267 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:20.556241    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:20.659543 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:20.659506    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:20.731987 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:20.731956    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:20.881234 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:20.881154    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z9lt8" event={"ID":"7c4f431a-01f0-4d42-a5e9-956bd037771e","Type":"ContainerStarted","Data":"b4239892dc59256f496fdcec490f2c3c4e0d5890e96164d3b5d439fab58f14cc"}
Jul 15 14:31:20.884011 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:20.883984    2574 generic.go:356] "Generic (PLEG): container finished" podID="a4916d51-34b1-46b9-bd0b-fa0eeda5b548" containerID="9fd176d29e74120e4b6a5d402df40bbd1a5180340442c178de6414c7a1303fc5" exitCode=0
Jul 15 14:31:20.884122 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:20.884033    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcgjm" event={"ID":"a4916d51-34b1-46b9-bd0b-fa0eeda5b548","Type":"ContainerDied","Data":"9fd176d29e74120e4b6a5d402df40bbd1a5180340442c178de6414c7a1303fc5"}
Jul 15 14:31:20.898055 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:20.898013    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z9lt8" podStartSLOduration=1.448918071 podStartE2EDuration="5.89800095s" totalImagesPullingTime="4.449082879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:20.896794593 +0000 UTC m=+40.789898957" watchObservedRunningTime="2026-07-15 14:31:20.89800095 +0000 UTC m=+40.791105353"
Jul 15 14:31:21.888996 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:21.888957    2574 generic.go:356] "Generic (PLEG): container finished" podID="a4916d51-34b1-46b9-bd0b-fa0eeda5b548" containerID="c739304017fe21d58f58d8a0f2e37cdc7f367d897336a31a7dce91b2138e3388" exitCode=0
Jul 15 14:31:21.889380 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:21.889034    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcgjm" event={"ID":"a4916d51-34b1-46b9-bd0b-fa0eeda5b548","Type":"ContainerDied","Data":"c739304017fe21d58f58d8a0f2e37cdc7f367d897336a31a7dce91b2138e3388"}
Jul 15 14:31:22.894253 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:22.894217    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gcgjm" event={"ID":"a4916d51-34b1-46b9-bd0b-fa0eeda5b548","Type":"ContainerStarted","Data":"d67274133a9c45e42c6f805ce099fd39d5c68032aa9a4c61c33b94a6a773fa38"}
Jul 15 14:31:22.920121 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:22.920077    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gcgjm" podStartSLOduration=8.276900195 podStartE2EDuration="41.920062316s" totalImagesPullingTime="33.643162121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:22.918575929 +0000 UTC m=+42.811680320" watchObservedRunningTime="2026-07-15 14:31:22.920062316 +0000 UTC m=+42.813166681"
Jul 15 14:31:23.050498 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:23.050465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:23.146402 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:23.146329    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:23.246294 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:23.246259    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:23.246448 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:23.246314    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:23.246448 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:23.246406    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:23.246448 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:23.246421    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:23.246448 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:23.246448    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6875b777db-qxrk2: secret "image-registry-tls" not found
Jul 15 14:31:23.246602 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:23.246455    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls podName:ce4d862f-aeea-4d7e-a38e-bbd2ea25a233 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:31.2464422 +0000 UTC m=+51.139546543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls") pod "dns-default-rwh8s" (UID: "ce4d862f-aeea-4d7e-a38e-bbd2ea25a233") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:23.246602 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:23.246500    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls podName:3cfbf9a0-89ec-410f-9216-611b7c74a7ea nodeName:}" failed. No retries permitted until 2026-07-15 14:31:31.246482283 +0000 UTC m=+51.139586656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls") pod "image-registry-6875b777db-qxrk2" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea") : secret "image-registry-tls" not found
Jul 15 14:31:23.258721 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:23.258666    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:23.358151 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:23.358107    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:25.818790 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:25.818751    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:25.886968 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:25.886936    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:26.420097 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.420068    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qrdwx"]
Jul 15 14:31:26.432030 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.432007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.436313 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.436294    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 14:31:26.437534 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.437514    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qr4w9\""
Jul 15 14:31:26.437644 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.437541    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 14:31:26.439893 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.439877    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 14:31:26.440146 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.440114    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 14:31:26.460904 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.460883    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qrdwx"]
Jul 15 14:31:26.470265 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.470246    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9a30e2b-0077-467f-bfd9-0f575080f050-data-volume\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.470372 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.470280    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxg26\" (UniqueName: \"kubernetes.io/projected/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-api-access-nxg26\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.470372 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.470319    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b9a30e2b-0077-467f-bfd9-0f575080f050-crio-socket\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.470470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.470372    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.470470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.470409    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.532110 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.532075    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:26.571464 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.571438    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9a30e2b-0077-467f-bfd9-0f575080f050-data-volume\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.571599 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.571477    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxg26\" (UniqueName: \"kubernetes.io/projected/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-api-access-nxg26\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.571599 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.571511    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b9a30e2b-0077-467f-bfd9-0f575080f050-crio-socket\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.571599 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.571550    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.571599 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.571586    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.571782 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:26.571659    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:31:26.571782 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:26.571694    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:26.571782 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:26.571735    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm podName:b9a30e2b-0077-467f-bfd9-0f575080f050 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:27.071716606 +0000 UTC m=+46.964820966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrdwx" (UID: "b9a30e2b-0077-467f-bfd9-0f575080f050") : configmap "kube-rbac-proxy" not found
Jul 15 14:31:26.571782 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:26.571761    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls podName:b9a30e2b-0077-467f-bfd9-0f575080f050 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:27.071744695 +0000 UTC m=+46.964849052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrdwx" (UID: "b9a30e2b-0077-467f-bfd9-0f575080f050") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:26.571782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.571764    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b9a30e2b-0077-467f-bfd9-0f575080f050-crio-socket\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.571975 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.571812    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9a30e2b-0077-467f-bfd9-0f575080f050-data-volume\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.594254 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.594227    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxg26\" (UniqueName: \"kubernetes.io/projected/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-api-access-nxg26\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:26.630061 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.630033    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:26.724033 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:26.723961    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:27.065619 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:27.065534    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:27.075558 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:27.075536    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:27.075653 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:27.075595    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:27.075688 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:27.075663    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:31:27.075722 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:27.075717    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm podName:b9a30e2b-0077-467f-bfd9-0f575080f050 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:28.075702857 +0000 UTC m=+47.968807200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrdwx" (UID: "b9a30e2b-0077-467f-bfd9-0f575080f050") : configmap "kube-rbac-proxy" not found
Jul 15 14:31:27.075761 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:27.075668    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:27.075812 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:27.075803    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls podName:b9a30e2b-0077-467f-bfd9-0f575080f050 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:28.075788967 +0000 UTC m=+47.968893310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrdwx" (UID: "b9a30e2b-0077-467f-bfd9-0f575080f050") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:27.171174 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:27.171123    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:27.315390 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:27.315359    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:27.786365 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:27.786332    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:27.884292 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:27.884261    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:28.082666 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:28.082577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:28.082666 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:28.082619    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:28.083042 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:28.082737    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:28.083042 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:28.082789    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:31:28.083042 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:28.082849    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls podName:b9a30e2b-0077-467f-bfd9-0f575080f050 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:30.082827384 +0000 UTC m=+49.975931752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrdwx" (UID: "b9a30e2b-0077-467f-bfd9-0f575080f050") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:28.083042 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:28.082870    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm podName:b9a30e2b-0077-467f-bfd9-0f575080f050 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:30.082861223 +0000 UTC m=+49.975965581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrdwx" (UID: "b9a30e2b-0077-467f-bfd9-0f575080f050") : configmap "kube-rbac-proxy" not found
Jul 15 14:31:28.624472 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:28.624445    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m4b6r_d09b0399-d94d-4fab-be6c-912f4fd178d0/dns-node-resolver/0.log"
Jul 15 14:31:29.386623 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.386592    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-c26pz"]
Jul 15 14:31:29.410905 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.410879    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-c26pz"]
Jul 15 14:31:29.411052 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.410966    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz"
Jul 15 14:31:29.413887 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.413863    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 15 14:31:29.414045 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.414031    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 15 14:31:29.414309 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.414293    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 15 14:31:29.415190 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.415173    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 15 14:31:29.415299 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.415208    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-74cgv\""
Jul 15 14:31:29.427359 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.427341    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9lhc5_55c22770-2f5a-40f0-b5cd-bcf852bf9109/node-ca/0.log"
Jul 15 14:31:29.483644 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.483616    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:29.493760 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.493740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/73646711-a091-4d31-ae34-b05e109c012e-signing-cabundle\") pod \"service-ca-79f68b9f4f-c26pz\" (UID: \"73646711-a091-4d31-ae34-b05e109c012e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz"
Jul 15 14:31:29.493896 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.493868    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz9xk\" (UniqueName: \"kubernetes.io/projected/73646711-a091-4d31-ae34-b05e109c012e-kube-api-access-wz9xk\") pod \"service-ca-79f68b9f4f-c26pz\" (UID: \"73646711-a091-4d31-ae34-b05e109c012e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz"
Jul 15 14:31:29.493969 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.493933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/73646711-a091-4d31-ae34-b05e109c012e-signing-key\") pod \"service-ca-79f68b9f4f-c26pz\" (UID: \"73646711-a091-4d31-ae34-b05e109c012e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz"
Jul 15 14:31:29.583498 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.583471    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:29.594754 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.594730    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz9xk\" (UniqueName: \"kubernetes.io/projected/73646711-a091-4d31-ae34-b05e109c012e-kube-api-access-wz9xk\") pod \"service-ca-79f68b9f4f-c26pz\" (UID: \"73646711-a091-4d31-ae34-b05e109c012e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz"
Jul 15 14:31:29.594854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.594766    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/73646711-a091-4d31-ae34-b05e109c012e-signing-key\") pod \"service-ca-79f68b9f4f-c26pz\" (UID: \"73646711-a091-4d31-ae34-b05e109c012e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz"
Jul 15 14:31:29.594854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.594786    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/73646711-a091-4d31-ae34-b05e109c012e-signing-cabundle\") pod \"service-ca-79f68b9f4f-c26pz\" (UID: \"73646711-a091-4d31-ae34-b05e109c012e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz"
Jul 15 14:31:29.595487 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.595469    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/73646711-a091-4d31-ae34-b05e109c012e-signing-cabundle\") pod \"service-ca-79f68b9f4f-c26pz\" (UID: \"73646711-a091-4d31-ae34-b05e109c012e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz"
Jul 15 14:31:29.597027 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.597010    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/73646711-a091-4d31-ae34-b05e109c012e-signing-key\") pod \"service-ca-79f68b9f4f-c26pz\" (UID: \"73646711-a091-4d31-ae34-b05e109c012e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz"
Jul 15 14:31:29.603985 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.603959    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz9xk\" (UniqueName: \"kubernetes.io/projected/73646711-a091-4d31-ae34-b05e109c012e-kube-api-access-wz9xk\") pod \"service-ca-79f68b9f4f-c26pz\" (UID: \"73646711-a091-4d31-ae34-b05e109c012e\") " pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz"
Jul 15 14:31:29.719793 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.719760    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz"
Jul 15 14:31:29.864048 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.864015    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-c26pz"]
Jul 15 14:31:29.866877 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:31:29.866849    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73646711_a091_4d31_ae34_b05e109c012e.slice/crio-474cb144e9b8a487429a38a1d1e13a00d0013cf4f67c1866fff2a89a72df65f3 WatchSource:0}: Error finding container 474cb144e9b8a487429a38a1d1e13a00d0013cf4f67c1866fff2a89a72df65f3: Status 404 returned error can't find the container with id 474cb144e9b8a487429a38a1d1e13a00d0013cf4f67c1866fff2a89a72df65f3
Jul 15 14:31:29.911053 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:29.911015    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz" event={"ID":"73646711-a091-4d31-ae34-b05e109c012e","Type":"ContainerStarted","Data":"474cb144e9b8a487429a38a1d1e13a00d0013cf4f67c1866fff2a89a72df65f3"}
Jul 15 14:31:30.104976 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:30.104880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:30.104976 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:30.104925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:30.105207 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:30.104995    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:31:30.105207 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:30.105027    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:30.105207 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:30.105049    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm podName:b9a30e2b-0077-467f-bfd9-0f575080f050 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:34.105035221 +0000 UTC m=+53.998139566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qrdwx" (UID: "b9a30e2b-0077-467f-bfd9-0f575080f050") : configmap "kube-rbac-proxy" not found
Jul 15 14:31:30.105207 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:30.105080    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls podName:b9a30e2b-0077-467f-bfd9-0f575080f050 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:34.105065922 +0000 UTC m=+53.998170267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrdwx" (UID: "b9a30e2b-0077-467f-bfd9-0f575080f050") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:30.428285 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:30.428262    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z9lt8_7c4f431a-01f0-4d42-a5e9-956bd037771e/serve-healthcheck-canary/0.log"
Jul 15 14:31:30.503434 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:30.503393    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:31.154350 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:31.154312    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:31.314085 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:31.314045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:31.314085 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:31.314084    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:31.314323 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:31.314219    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:31:31.314323 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:31.314243    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6875b777db-qxrk2: secret "image-registry-tls" not found
Jul 15 14:31:31.314323 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:31.314293    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls podName:3cfbf9a0-89ec-410f-9216-611b7c74a7ea nodeName:}" failed. No retries permitted until 2026-07-15 14:31:47.314276815 +0000 UTC m=+67.207381159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls") pod "image-registry-6875b777db-qxrk2" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea") : secret "image-registry-tls" not found
Jul 15 14:31:31.314323 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:31.314228    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:31:31.314455 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:31.314354    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls podName:ce4d862f-aeea-4d7e-a38e-bbd2ea25a233 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:47.314343437 +0000 UTC m=+67.207447781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls") pod "dns-default-rwh8s" (UID: "ce4d862f-aeea-4d7e-a38e-bbd2ea25a233") : secret "dns-default-metrics-tls" not found
Jul 15 14:31:33.340734 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:33.340701    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:33.441378 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:33.441347    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:33.619866 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:33.619834    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:33.697181 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:33.697121    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:33.921193 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:33.921124    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz" event={"ID":"73646711-a091-4d31-ae34-b05e109c012e","Type":"ContainerStarted","Data":"6da7d9074ff7324dfe6d4b4eeebc1c268604e7f88e69887305c25c1c0d02bdd4"}
Jul 15 14:31:33.939304 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:33.939256    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-c26pz" podStartSLOduration=1.217170747 podStartE2EDuration="4.939238885s" totalImagesPullingTime="3.722068138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:33.937814586 +0000 UTC m=+53.830918951" watchObservedRunningTime="2026-07-15 14:31:33.939238885 +0000 UTC m=+53.832343251"
Jul 15 14:31:34.058027 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:34.057987    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:34.139467 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:34.139430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:34.139664 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:34.139484    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:34.139664 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:34.139573    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:34.139664 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:31:34.139639    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls podName:b9a30e2b-0077-467f-bfd9-0f575080f050 nodeName:}" failed. No retries permitted until 2026-07-15 14:31:42.1396224 +0000 UTC m=+62.032726748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qrdwx" (UID: "b9a30e2b-0077-467f-bfd9-0f575080f050") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:31:34.140005 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:34.139981    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9a30e2b-0077-467f-bfd9-0f575080f050-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:35.200629 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:35.200583    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:35.301371 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:35.301340    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:35.412793 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:35.412762    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:35.560562 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:35.560446    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:35.665315 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:35.665265    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:35.779869 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:35.779835    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:35.897434 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:35.897342    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:36.673973 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:36.673939    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:37.057802 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:37.057723    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:37.353723 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:37.353647    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:37.666273 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:37.666227    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:38.455079 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:38.455046    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:38.662743 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:38.662711    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:38.858317 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:38.858223    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:38.986661 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:38.986629    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:39.087015 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:39.086982    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:39.253503 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:39.253474    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:39.657416 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:39.657382    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:39.745688 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:39.745655    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:40.258976 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:40.258942    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:40.873513 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:40.873472    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:41.068552 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:41.068516    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:41.322701 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:41.322665    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:41.456467 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:41.456437    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:41.672446 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:41.672417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:41.871079 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:41.871049    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w9lj2"
Jul 15 14:31:42.053195 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:42.053089    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:42.203913 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:42.203882    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:42.206191 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:42.206158    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9a30e2b-0077-467f-bfd9-0f575080f050-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qrdwx\" (UID: \"b9a30e2b-0077-467f-bfd9-0f575080f050\") " pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:42.343679 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:42.343593    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qr4w9\""
Jul 15 14:31:42.350958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:42.350936    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qrdwx"
Jul 15 14:31:42.483647 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:42.483616    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:42.489352 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:42.489319    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qrdwx"]
Jul 15 14:31:42.492208 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:31:42.492179    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a30e2b_0077_467f_bfd9_0f575080f050.slice/crio-66c4fc0fff39a755e949cc855aefba278d6e6a3b6fd2980486caeed96bae4513 WatchSource:0}: Error finding container 66c4fc0fff39a755e949cc855aefba278d6e6a3b6fd2980486caeed96bae4513: Status 404 returned error can't find the container with id 66c4fc0fff39a755e949cc855aefba278d6e6a3b6fd2980486caeed96bae4513
Jul 15 14:31:42.664094 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:42.664063    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:42.944458 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:42.944373    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrdwx" event={"ID":"b9a30e2b-0077-467f-bfd9-0f575080f050","Type":"ContainerStarted","Data":"66c4fc0fff39a755e949cc855aefba278d6e6a3b6fd2980486caeed96bae4513"}
Jul 15 14:31:43.054579 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:43.054519    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:43.474159 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:43.474092    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:43.856194 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:43.856097    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:44.275998 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:44.275957    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:44.461962 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:44.461928    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:44.855253 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:44.855225    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:45.470740 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:45.470707    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:45.666478 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:45.666441    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:45.888733 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:45.888655    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:46.338679 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.338633    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:46.341952 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.341923    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 14:31:46.351945 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.351919    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87271241-2e0f-48e4-a296-7842b26dd134-original-pull-secret\") pod \"global-pull-secret-syncer-hr7xh\" (UID: \"87271241-2e0f-48e4-a296-7842b26dd134\") " pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:46.370158 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.370106    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hr7xh"
Jul 15 14:31:46.439557 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.439526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:46.442569 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.442542    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 14:31:46.452541 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.452507    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7960d43c-998b-486e-9138-e015127e6877-metrics-certs\") pod \"network-metrics-daemon-5qsjj\" (UID: \"7960d43c-998b-486e-9138-e015127e6877\") " pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:46.540008 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.539977    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6ftx\" (UniqueName: \"kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx\") pod \"network-check-target-9swdm\" (UID: \"a4d3a2e0-b568-46a0-bdd8-c80704c57326\") " pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:46.543052 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.543028    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 14:31:46.553375 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.553354    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 14:31:46.563444 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.563411    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6ftx\" (UniqueName: \"kubernetes.io/projected/a4d3a2e0-b568-46a0-bdd8-c80704c57326-kube-api-access-c6ftx\") pod \"network-check-target-9swdm\" (UID: \"a4d3a2e0-b568-46a0-bdd8-c80704c57326\") " pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:46.664852 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.664827    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cj2n5\""
Jul 15 14:31:46.672261 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.672243    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:46.681432 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.681408    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cqtkh\""
Jul 15 14:31:46.688913 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:46.688891    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5qsjj"
Jul 15 14:31:47.347868 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.347826    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:47.348052 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.347880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:47.350824 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.350796    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce4d862f-aeea-4d7e-a38e-bbd2ea25a233-metrics-tls\") pod \"dns-default-rwh8s\" (UID: \"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233\") " pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:47.350968 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.350918    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls\") pod \"image-registry-6875b777db-qxrk2\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") " pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:47.507738 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.507713    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z6j7k\""
Jul 15 14:31:47.515560 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.515155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:47.515560 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.515539    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5qsjj"]
Jul 15 14:31:47.519099 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:31:47.519074    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7960d43c_998b_486e_9138_e015127e6877.slice/crio-57d90820537e620421a3e030b0c9323f54e9da049f1cf46f690b694fb93fa10c WatchSource:0}: Error finding container 57d90820537e620421a3e030b0c9323f54e9da049f1cf46f690b694fb93fa10c: Status 404 returned error can't find the container with id 57d90820537e620421a3e030b0c9323f54e9da049f1cf46f690b694fb93fa10c
Jul 15 14:31:47.527389 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.527367    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ns9wp\""
Jul 15 14:31:47.535840 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.535784    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:47.653374 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.653344    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6875b777db-qxrk2"]
Jul 15 14:31:47.656502 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:31:47.656476    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfbf9a0_89ec_410f_9216_611b7c74a7ea.slice/crio-e70fa2dc5dafd1a9f21180f792f5ec80be58abb4f4446ec133767c10c81f91e9 WatchSource:0}: Error finding container e70fa2dc5dafd1a9f21180f792f5ec80be58abb4f4446ec133767c10c81f91e9: Status 404 returned error can't find the container with id e70fa2dc5dafd1a9f21180f792f5ec80be58abb4f4446ec133767c10c81f91e9
Jul 15 14:31:47.667267 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.667222    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rwh8s"]
Jul 15 14:31:47.669774 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:31:47.669746    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4d862f_aeea_4d7e_a38e_bbd2ea25a233.slice/crio-1c72926f80786e4709450e5905a8b9d631227c11d904b362da9c58e52b673fc3 WatchSource:0}: Error finding container 1c72926f80786e4709450e5905a8b9d631227c11d904b362da9c58e52b673fc3: Status 404 returned error can't find the container with id 1c72926f80786e4709450e5905a8b9d631227c11d904b362da9c58e52b673fc3
Jul 15 14:31:47.741377 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.741351    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hr7xh"]
Jul 15 14:31:47.742991 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.742973    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9swdm"]
Jul 15 14:31:47.746697 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:31:47.746649    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87271241_2e0f_48e4_a296_7842b26dd134.slice/crio-f22d4eacf0821c1f1a9378b7c56de872b2169040f48d58c5d4a9365fc4f45c6c WatchSource:0}: Error finding container f22d4eacf0821c1f1a9378b7c56de872b2169040f48d58c5d4a9365fc4f45c6c: Status 404 returned error can't find the container with id f22d4eacf0821c1f1a9378b7c56de872b2169040f48d58c5d4a9365fc4f45c6c
Jul 15 14:31:47.747535 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:31:47.747501    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d3a2e0_b568_46a0_bdd8_c80704c57326.slice/crio-e32babde4a77d38cf8cd1b2d867f745e5c6312f92567ae46d1cb6154793b7b75 WatchSource:0}: Error finding container e32babde4a77d38cf8cd1b2d867f745e5c6312f92567ae46d1cb6154793b7b75: Status 404 returned error can't find the container with id e32babde4a77d38cf8cd1b2d867f745e5c6312f92567ae46d1cb6154793b7b75
Jul 15 14:31:47.959873 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.959832    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5qsjj" event={"ID":"7960d43c-998b-486e-9138-e015127e6877","Type":"ContainerStarted","Data":"57d90820537e620421a3e030b0c9323f54e9da049f1cf46f690b694fb93fa10c"}
Jul 15 14:31:47.961658 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.961589    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hr7xh" event={"ID":"87271241-2e0f-48e4-a296-7842b26dd134","Type":"ContainerStarted","Data":"f22d4eacf0821c1f1a9378b7c56de872b2169040f48d58c5d4a9365fc4f45c6c"}
Jul 15 14:31:47.963185 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.963159    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwh8s" event={"ID":"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233","Type":"ContainerStarted","Data":"1c72926f80786e4709450e5905a8b9d631227c11d904b362da9c58e52b673fc3"}
Jul 15 14:31:47.964965 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.964942    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6875b777db-qxrk2" event={"ID":"3cfbf9a0-89ec-410f-9216-611b7c74a7ea","Type":"ContainerStarted","Data":"d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8"}
Jul 15 14:31:47.965061 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.964980    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6875b777db-qxrk2" event={"ID":"3cfbf9a0-89ec-410f-9216-611b7c74a7ea","Type":"ContainerStarted","Data":"e70fa2dc5dafd1a9f21180f792f5ec80be58abb4f4446ec133767c10c81f91e9"}
Jul 15 14:31:47.965225 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.965203    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:31:47.966891 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.966847    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9swdm" event={"ID":"a4d3a2e0-b568-46a0-bdd8-c80704c57326","Type":"ContainerStarted","Data":"e32babde4a77d38cf8cd1b2d867f745e5c6312f92567ae46d1cb6154793b7b75"}
Jul 15 14:31:47.968675 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:47.968647    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrdwx" event={"ID":"b9a30e2b-0077-467f-bfd9-0f575080f050","Type":"ContainerStarted","Data":"dab6f3191aff07f7e9d273f3c6f27339cc17fe5b8d493f36785e1e863a8e54d0"}
Jul 15 14:31:48.342457 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:48.342213    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:48.423487 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:48.423369    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:49.917466 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.915789    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6875b777db-qxrk2" podStartSLOduration=54.915760461 podStartE2EDuration="54.915760461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:47.989653224 +0000 UTC m=+67.882757591" watchObservedRunningTime="2026-07-15 14:31:49.915760461 +0000 UTC m=+69.808864828"
Jul 15 14:31:49.917466 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.916457    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"]
Jul 15 14:31:49.927055 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.927027    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:31:49.933371 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.932920    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 14:31:49.933371 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.933024    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 14:31:49.933371 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.933212    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 14:31:49.934619 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.934593    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 14:31:49.952724 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.952696    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm"]
Jul 15 14:31:49.955959 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.955933    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"]
Jul 15 14:31:49.956086 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.956056    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm"
Jul 15 14:31:49.959690 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.959445    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 14:31:49.959803 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.959741    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pf66f\""
Jul 15 14:31:49.978493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:49.978430    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm"]
Jul 15 14:31:50.051066 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.051026    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6875b777db-qxrk2"]
Jul 15 14:31:50.073313 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.073278    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/923d28db-df6e-4182-abbb-0a48525f9c23-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm\" (UID: \"923d28db-df6e-4182-abbb-0a48525f9c23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm"
Jul 15 14:31:50.073481 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.073328    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmsm9\" (UniqueName: \"kubernetes.io/projected/0fed2b10-1374-4657-a435-6f7b5772e591-kube-api-access-xmsm9\") pod \"klusterlet-addon-workmgr-6f49dd984-2d7fz\" (UID: \"0fed2b10-1374-4657-a435-6f7b5772e591\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:31:50.073481 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.073390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0fed2b10-1374-4657-a435-6f7b5772e591-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f49dd984-2d7fz\" (UID: \"0fed2b10-1374-4657-a435-6f7b5772e591\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:31:50.073481 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.073443    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lgc4\" (UniqueName: \"kubernetes.io/projected/923d28db-df6e-4182-abbb-0a48525f9c23-kube-api-access-7lgc4\") pod \"managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm\" (UID: \"923d28db-df6e-4182-abbb-0a48525f9c23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm"
Jul 15 14:31:50.073614 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.073513    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fed2b10-1374-4657-a435-6f7b5772e591-tmp\") pod \"klusterlet-addon-workmgr-6f49dd984-2d7fz\" (UID: \"0fed2b10-1374-4657-a435-6f7b5772e591\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:31:50.158311 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.158267    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:50.175239 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.174254    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fed2b10-1374-4657-a435-6f7b5772e591-tmp\") pod \"klusterlet-addon-workmgr-6f49dd984-2d7fz\" (UID: \"0fed2b10-1374-4657-a435-6f7b5772e591\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:31:50.175239 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.174320    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/923d28db-df6e-4182-abbb-0a48525f9c23-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm\" (UID: \"923d28db-df6e-4182-abbb-0a48525f9c23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm"
Jul 15 14:31:50.175239 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.174358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmsm9\" (UniqueName: \"kubernetes.io/projected/0fed2b10-1374-4657-a435-6f7b5772e591-kube-api-access-xmsm9\") pod \"klusterlet-addon-workmgr-6f49dd984-2d7fz\" (UID: \"0fed2b10-1374-4657-a435-6f7b5772e591\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:31:50.175239 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.174378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0fed2b10-1374-4657-a435-6f7b5772e591-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f49dd984-2d7fz\" (UID: \"0fed2b10-1374-4657-a435-6f7b5772e591\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:31:50.175239 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.174415    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lgc4\" (UniqueName: \"kubernetes.io/projected/923d28db-df6e-4182-abbb-0a48525f9c23-kube-api-access-7lgc4\") pod \"managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm\" (UID: \"923d28db-df6e-4182-abbb-0a48525f9c23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm"
Jul 15 14:31:50.175239 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.175147    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fed2b10-1374-4657-a435-6f7b5772e591-tmp\") pod \"klusterlet-addon-workmgr-6f49dd984-2d7fz\" (UID: \"0fed2b10-1374-4657-a435-6f7b5772e591\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:31:50.178292 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.178269    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0fed2b10-1374-4657-a435-6f7b5772e591-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f49dd984-2d7fz\" (UID: \"0fed2b10-1374-4657-a435-6f7b5772e591\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:31:50.178444 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.178420    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/923d28db-df6e-4182-abbb-0a48525f9c23-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm\" (UID: \"923d28db-df6e-4182-abbb-0a48525f9c23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm"
Jul 15 14:31:50.201959 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.201898    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmsm9\" (UniqueName: \"kubernetes.io/projected/0fed2b10-1374-4657-a435-6f7b5772e591-kube-api-access-xmsm9\") pod \"klusterlet-addon-workmgr-6f49dd984-2d7fz\" (UID: \"0fed2b10-1374-4657-a435-6f7b5772e591\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:31:50.208194 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.208160    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lgc4\" (UniqueName: \"kubernetes.io/projected/923d28db-df6e-4182-abbb-0a48525f9c23-kube-api-access-7lgc4\") pod \"managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm\" (UID: \"923d28db-df6e-4182-abbb-0a48525f9c23\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm"
Jul 15 14:31:50.241249 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.241204    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:31:50.281516 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.281485    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm"
Jul 15 14:31:50.294998 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.294926    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:50.489527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.489443    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:50.614374 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.614338    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:50.743884 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:50.743801    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:55.543065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:55.543037    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm"]
Jul 15 14:31:55.546182 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:31:55.546158    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod923d28db_df6e_4182_abbb_0a48525f9c23.slice/crio-4ba3adc406d5e8803a42f56f02b76d143778ca0b5ab7067d353ecf07bf008799 WatchSource:0}: Error finding container 4ba3adc406d5e8803a42f56f02b76d143778ca0b5ab7067d353ecf07bf008799: Status 404 returned error can't find the container with id 4ba3adc406d5e8803a42f56f02b76d143778ca0b5ab7067d353ecf07bf008799
Jul 15 14:31:55.552560 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:55.552538    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"]
Jul 15 14:31:55.555206 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:31:55.555178    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fed2b10_1374_4657_a435_6f7b5772e591.slice/crio-005bb4551e56dda47dd07f23a34c540d46b273f12cc3c48f295ecba5fa618bf5 WatchSource:0}: Error finding container 005bb4551e56dda47dd07f23a34c540d46b273f12cc3c48f295ecba5fa618bf5: Status 404 returned error can't find the container with id 005bb4551e56dda47dd07f23a34c540d46b273f12cc3c48f295ecba5fa618bf5
Jul 15 14:31:55.999004 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:55.998918    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hr7xh" event={"ID":"87271241-2e0f-48e4-a296-7842b26dd134","Type":"ContainerStarted","Data":"c114012f3e9c906283d1549b598cf8b4a3387d78b5c20f3e556f4cd49c754fd2"}
Jul 15 14:31:56.000147 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.000112    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz" event={"ID":"0fed2b10-1374-4657-a435-6f7b5772e591","Type":"ContainerStarted","Data":"005bb4551e56dda47dd07f23a34c540d46b273f12cc3c48f295ecba5fa618bf5"}
Jul 15 14:31:56.001182 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.001152    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm" event={"ID":"923d28db-df6e-4182-abbb-0a48525f9c23","Type":"ContainerStarted","Data":"4ba3adc406d5e8803a42f56f02b76d143778ca0b5ab7067d353ecf07bf008799"}
Jul 15 14:31:56.002813 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.002789    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwh8s" event={"ID":"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233","Type":"ContainerStarted","Data":"1ace690a9a06ce8ac7926ce775e7c0f78d28076f3dcaffbcb6f5e1e408e8c1af"}
Jul 15 14:31:56.002913 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.002829    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rwh8s" event={"ID":"ce4d862f-aeea-4d7e-a38e-bbd2ea25a233","Type":"ContainerStarted","Data":"8a04c9049842ae2c6b83ddbc6f915b2f1b0ce47dfe62ecb95bd58d8874436a19"}
Jul 15 14:31:56.002913 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.002860    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:31:56.004294 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.004273    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9swdm" event={"ID":"a4d3a2e0-b568-46a0-bdd8-c80704c57326","Type":"ContainerStarted","Data":"3351f456b6f1d003e9dafc95d254788e42a0a653986dc25c87cd4b368c660f8c"}
Jul 15 14:31:56.004381 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.004344    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:31:56.005906 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.005888    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrdwx" event={"ID":"b9a30e2b-0077-467f-bfd9-0f575080f050","Type":"ContainerStarted","Data":"0893351dc3e12ab92a0227cd7a89b06b4f20d75f1fc666eeccd49a61d6b26f9a"}
Jul 15 14:31:56.007489 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.007471    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5qsjj" event={"ID":"7960d43c-998b-486e-9138-e015127e6877","Type":"ContainerStarted","Data":"4769146f68e8a516f55a5d843c7b9793c2b093c485c14b80e29b77eb549a00cc"}
Jul 15 14:31:56.007565 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.007502    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5qsjj" event={"ID":"7960d43c-998b-486e-9138-e015127e6877","Type":"ContainerStarted","Data":"e652e588c7d16675f95ac6374e303dc26a9edae003eafd55d2f64d86b1d162c9"}
Jul 15 14:31:56.017683 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.017636    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hr7xh" podStartSLOduration=67.3977736 podStartE2EDuration="1m15.017619411s" totalImagesPullingTime="7.619845811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:56.016808912 +0000 UTC m=+75.909913278" watchObservedRunningTime="2026-07-15 14:31:56.017619411 +0000 UTC m=+75.910723789"
Jul 15 14:31:56.035259 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.035216    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rwh8s" podStartSLOduration=33.33295867 podStartE2EDuration="41.035201145s" totalImagesPullingTime="7.702242475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:56.03440716 +0000 UTC m=+75.927511530" watchObservedRunningTime="2026-07-15 14:31:56.035201145 +0000 UTC m=+75.928305554"
Jul 15 14:31:56.051787 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.051732    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9swdm" podStartSLOduration=67.433255382 podStartE2EDuration="1m15.051715045s" totalImagesPullingTime="7.618459663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:56.050818084 +0000 UTC m=+75.943922455" watchObservedRunningTime="2026-07-15 14:31:56.051715045 +0000 UTC m=+75.944819410"
Jul 15 14:31:56.070037 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.069986    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5qsjj" podStartSLOduration=67.583744511 podStartE2EDuration="1m15.069971546s" totalImagesPullingTime="7.486227035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:31:56.069268859 +0000 UTC m=+75.962373248" watchObservedRunningTime="2026-07-15 14:31:56.069971546 +0000 UTC m=+75.963075925"
Jul 15 14:31:56.236546 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.236512    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:56.338912 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.337439    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:56.338912 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.338605    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-9bhfb"]
Jul 15 14:31:56.340767 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.340646    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-9bhfb"
Jul 15 14:31:56.343446 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.343286    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 14:31:56.343627 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.343610    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 14:31:56.343862 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.343842    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-f588r\""
Jul 15 14:31:56.355599 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.355568    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-9bhfb"]
Jul 15 14:31:56.420126 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.420092    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:56.423265 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.423154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6f4k\" (UniqueName: \"kubernetes.io/projected/96ea9402-b03e-43f5-8921-dbc6bb916083-kube-api-access-w6f4k\") pod \"downloads-68c9cbb497-9bhfb\" (UID: \"96ea9402-b03e-43f5-8921-dbc6bb916083\") " pod="openshift-console/downloads-68c9cbb497-9bhfb"
Jul 15 14:31:56.524401 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.524308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6f4k\" (UniqueName: \"kubernetes.io/projected/96ea9402-b03e-43f5-8921-dbc6bb916083-kube-api-access-w6f4k\") pod \"downloads-68c9cbb497-9bhfb\" (UID: \"96ea9402-b03e-43f5-8921-dbc6bb916083\") " pod="openshift-console/downloads-68c9cbb497-9bhfb"
Jul 15 14:31:56.535557 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.535511    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6f4k\" (UniqueName: \"kubernetes.io/projected/96ea9402-b03e-43f5-8921-dbc6bb916083-kube-api-access-w6f4k\") pod \"downloads-68c9cbb497-9bhfb\" (UID: \"96ea9402-b03e-43f5-8921-dbc6bb916083\") " pod="openshift-console/downloads-68c9cbb497-9bhfb"
Jul 15 14:31:56.654037 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.654007    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-9bhfb"
Jul 15 14:31:56.717459 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.717389    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:56.867746 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:56.867654    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-9bhfb"]
Jul 15 14:31:56.872485 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:31:56.871824    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ea9402_b03e_43f5_8921_dbc6bb916083.slice/crio-f417df5264ec47000627712ab643d8c6002bd3116ebaccc84bcc486741465893 WatchSource:0}: Error finding container f417df5264ec47000627712ab643d8c6002bd3116ebaccc84bcc486741465893: Status 404 returned error can't find the container with id f417df5264ec47000627712ab643d8c6002bd3116ebaccc84bcc486741465893
Jul 15 14:31:57.015007 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:57.014481    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-9bhfb" event={"ID":"96ea9402-b03e-43f5-8921-dbc6bb916083","Type":"ContainerStarted","Data":"f417df5264ec47000627712ab643d8c6002bd3116ebaccc84bcc486741465893"}
Jul 15 14:31:57.361176 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:57.361024    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:57.462839 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:57.462766    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:57.527543 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:57.527460    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:57.856903 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:57.856835    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:58.354326 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:58.354279    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:58.455622 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:58.455551    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:59.048070 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:59.048039    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:31:59.119164 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:31:59.119112    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:01.523238 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.523165    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-795b9b9c94-kr5gx"]
Jul 15 14:32:01.526541 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.526519    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.530114 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.530089    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 14:32:01.531165 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.530998    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 14:32:01.531165 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.531037    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 14:32:01.531341 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.531319    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 14:32:01.531702 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.531604    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8czzb\""
Jul 15 14:32:01.531923 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.531800    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 14:32:01.545140 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.545111    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795b9b9c94-kr5gx"]
Jul 15 14:32:01.667305 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.667269    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-service-ca\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.667503 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.667315    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-config\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.667503 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.667349    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-oauth-serving-cert\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.667503 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.667371    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsk6n\" (UniqueName: \"kubernetes.io/projected/b76644ba-3f36-4723-8437-10dcc3eae3e5-kube-api-access-fsk6n\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.667503 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.667405    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-serving-cert\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.667503 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.667427    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-oauth-config\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.768749 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.768712    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-config\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.768935 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.768764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-oauth-serving-cert\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.768935 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.768791    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsk6n\" (UniqueName: \"kubernetes.io/projected/b76644ba-3f36-4723-8437-10dcc3eae3e5-kube-api-access-fsk6n\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.768935 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.768843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-serving-cert\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.768935 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.768877    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-oauth-config\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.768935 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.768916    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-service-ca\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.769796 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.769551    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-config\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.769796 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.769669    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-service-ca\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.769796 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.769773    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-oauth-serving-cert\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.772199 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.772167    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-serving-cert\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.772323 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.772284    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-oauth-config\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.783786 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.783725    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsk6n\" (UniqueName: \"kubernetes.io/projected/b76644ba-3f36-4723-8437-10dcc3eae3e5-kube-api-access-fsk6n\") pod \"console-795b9b9c94-kr5gx\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") " pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:01.839429 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:01.839196    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:02.153950 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.153917    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:02.196465 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.196431    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-x2z88"]
Jul 15 14:32:02.200002 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.199979    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.204559 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.204533    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 14:32:02.204688 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.204614    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 14:32:02.205469 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.205451    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 14:32:02.205616 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.205457    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 14:32:02.206071 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.205931    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 14:32:02.206071 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.205964    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xwdch\""
Jul 15 14:32:02.222457 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.222387    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-x2z88"]
Jul 15 14:32:02.261533 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.261428    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:02.375109 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.375038    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ddd7751-c199-4a6b-975c-41d5a1732f47-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.375109 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.375103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ddd7751-c199-4a6b-975c-41d5a1732f47-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.375323 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.375291    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thfxr\" (UniqueName: \"kubernetes.io/projected/7ddd7751-c199-4a6b-975c-41d5a1732f47-kube-api-access-thfxr\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.375372 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.375351    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ddd7751-c199-4a6b-975c-41d5a1732f47-metrics-client-ca\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.478558 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.478523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ddd7751-c199-4a6b-975c-41d5a1732f47-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.478672 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.478594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thfxr\" (UniqueName: \"kubernetes.io/projected/7ddd7751-c199-4a6b-975c-41d5a1732f47-kube-api-access-thfxr\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.478738 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.478699    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ddd7751-c199-4a6b-975c-41d5a1732f47-metrics-client-ca\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.479358 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.478836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ddd7751-c199-4a6b-975c-41d5a1732f47-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.479358 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:32:02.479020    2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 15 14:32:02.480105 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:32:02.480040    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ddd7751-c199-4a6b-975c-41d5a1732f47-prometheus-operator-tls podName:7ddd7751-c199-4a6b-975c-41d5a1732f47 nodeName:}" failed. No retries permitted until 2026-07-15 14:32:02.980015163 +0000 UTC m=+82.873119521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7ddd7751-c199-4a6b-975c-41d5a1732f47-prometheus-operator-tls") pod "prometheus-operator-64785b6675-x2z88" (UID: "7ddd7751-c199-4a6b-975c-41d5a1732f47") : secret "prometheus-operator-tls" not found
Jul 15 14:32:02.480105 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.480033    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ddd7751-c199-4a6b-975c-41d5a1732f47-metrics-client-ca\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.482349 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.482326    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ddd7751-c199-4a6b-975c-41d5a1732f47-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.491024 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.490937    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thfxr\" (UniqueName: \"kubernetes.io/projected/7ddd7751-c199-4a6b-975c-41d5a1732f47-kube-api-access-thfxr\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.554874 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.554712    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-795b9b9c94-kr5gx"]
Jul 15 14:32:02.558446 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:32:02.558420    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76644ba_3f36_4723_8437_10dcc3eae3e5.slice/crio-7ced035d2547c952a99b57f2cb89d0303877e6b971b73c12f53c63c02686cbc2 WatchSource:0}: Error finding container 7ced035d2547c952a99b57f2cb89d0303877e6b971b73c12f53c63c02686cbc2: Status 404 returned error can't find the container with id 7ced035d2547c952a99b57f2cb89d0303877e6b971b73c12f53c63c02686cbc2
Jul 15 14:32:02.887579 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.887500    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:02.982366 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.982335    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ddd7751-c199-4a6b-975c-41d5a1732f47-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:02.984868 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:02.984838    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7ddd7751-c199-4a6b-975c-41d5a1732f47-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-x2z88\" (UID: \"7ddd7751-c199-4a6b-975c-41d5a1732f47\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:03.041965 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:03.041910    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm" event={"ID":"923d28db-df6e-4182-abbb-0a48525f9c23","Type":"ContainerStarted","Data":"645f2d191ac5e883ad75ec1412af62224437cb1a61c1b305b74e7a933bfe8881"}
Jul 15 14:32:03.044455 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:03.044427    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qrdwx" event={"ID":"b9a30e2b-0077-467f-bfd9-0f575080f050","Type":"ContainerStarted","Data":"77ad2c60958a8675ad4c943a632a70ed4830c12f9b3b761121db64b02b1325fb"}
Jul 15 14:32:03.045820 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:03.045792    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795b9b9c94-kr5gx" event={"ID":"b76644ba-3f36-4723-8437-10dcc3eae3e5","Type":"ContainerStarted","Data":"7ced035d2547c952a99b57f2cb89d0303877e6b971b73c12f53c63c02686cbc2"}
Jul 15 14:32:03.047445 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:03.047421    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz" event={"ID":"0fed2b10-1374-4657-a435-6f7b5772e591","Type":"ContainerStarted","Data":"e2ecf83a16fce11b776e4db0a544be93c12dab09c11b4202556515ba5c51d3cc"}
Jul 15 14:32:03.047667 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:03.047642    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:32:03.049410 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:03.049391    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz"
Jul 15 14:32:03.066484 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:03.066442    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d47b8d9b6-xhvgm" podStartSLOduration=7.235881828 podStartE2EDuration="14.066429084s" totalImagesPullingTime="6.830547256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:03.06562799 +0000 UTC m=+82.958732357" watchObservedRunningTime="2026-07-15 14:32:03.066429084 +0000 UTC m=+82.959533443"
Jul 15 14:32:03.112581 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:03.112551    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88"
Jul 15 14:32:03.136827 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:03.136775    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f49dd984-2d7fz" podStartSLOduration=7.296494737 podStartE2EDuration="14.13675218s" totalImagesPullingTime="6.840257443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:03.097987824 +0000 UTC m=+82.991092189" watchObservedRunningTime="2026-07-15 14:32:03.13675218 +0000 UTC m=+83.029856548"
Jul 15 14:32:03.137196 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:03.137158    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qrdwx" podStartSLOduration=17.520347854 podStartE2EDuration="37.137149726s" totalImagesPullingTime="19.616801872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:31:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:03.136108337 +0000 UTC m=+83.029212704" watchObservedRunningTime="2026-07-15 14:32:03.137149726 +0000 UTC m=+83.030254089"
Jul 15 14:32:03.275493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:03.275458    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-x2z88"]
Jul 15 14:32:03.279287 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:32:03.279238    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ddd7751_c199_4a6b_975c_41d5a1732f47.slice/crio-9cd8f0048911b41d04911f53b254b5eb0bcb30ed2a17efcc35c7b096d661fbd2 WatchSource:0}: Error finding container 9cd8f0048911b41d04911f53b254b5eb0bcb30ed2a17efcc35c7b096d661fbd2: Status 404 returned error can't find the container with id 9cd8f0048911b41d04911f53b254b5eb0bcb30ed2a17efcc35c7b096d661fbd2
Jul 15 14:32:04.052566 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:04.052515    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88" event={"ID":"7ddd7751-c199-4a6b-975c-41d5a1732f47","Type":"ContainerStarted","Data":"9cd8f0048911b41d04911f53b254b5eb0bcb30ed2a17efcc35c7b096d661fbd2"}
Jul 15 14:32:06.018297 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:06.018266    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rwh8s"
Jul 15 14:32:06.881922 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:06.881813    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:07.066687 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:07.066651    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795b9b9c94-kr5gx" event={"ID":"b76644ba-3f36-4723-8437-10dcc3eae3e5","Type":"ContainerStarted","Data":"3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0"}
Jul 15 14:32:07.068884 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:07.068846    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88" event={"ID":"7ddd7751-c199-4a6b-975c-41d5a1732f47","Type":"ContainerStarted","Data":"de613fbd97ec27e6621e050c222143af28e5057ba8ce0643d4b2548dd59f2d09"}
Jul 15 14:32:07.069028 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:07.068902    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88" event={"ID":"7ddd7751-c199-4a6b-975c-41d5a1732f47","Type":"ContainerStarted","Data":"83515f62440e5ba5ed43b0727c32f26d91fc64bb3e78c0ab071727dc86aeb6ba"}
Jul 15 14:32:07.100428 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:07.100383    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-795b9b9c94-kr5gx" podStartSLOduration=2.165234835 podStartE2EDuration="6.100367745s" totalImagesPullingTime="3.93513291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:07.099886719 +0000 UTC m=+86.992991083" watchObservedRunningTime="2026-07-15 14:32:07.100367745 +0000 UTC m=+86.993472088"
Jul 15 14:32:07.129122 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:07.129073    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-x2z88" podStartSLOduration=1.915971058 podStartE2EDuration="5.129054459s" totalImagesPullingTime="3.213083401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:07.128950914 +0000 UTC m=+87.022055278" watchObservedRunningTime="2026-07-15 14:32:07.129054459 +0000 UTC m=+87.022158825"
Jul 15 14:32:08.326884 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.326846    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:08.530980 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.530914    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:08.617236 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.617102    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8vd4j"]
Jul 15 14:32:08.654976 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.654943    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.657873 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.657847    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 14:32:08.658144 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.658106    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9xfhr\""
Jul 15 14:32:08.658260 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.658223    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 14:32:08.660667 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.660645    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 14:32:08.674959 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.674933    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:08.729720 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.729687    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-textfile\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.729910 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.729727    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-wtmp\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.729910 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.729752    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbs6k\" (UniqueName: \"kubernetes.io/projected/1692b909-5265-40aa-9ad1-5d602ca0fa84-kube-api-access-cbs6k\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.729910 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.729776    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.729910 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.729846    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1692b909-5265-40aa-9ad1-5d602ca0fa84-sys\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.729910 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.729873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1692b909-5265-40aa-9ad1-5d602ca0fa84-root\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.730155 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.729913    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.730155 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.729952    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1692b909-5265-40aa-9ad1-5d602ca0fa84-metrics-client-ca\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.730155 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.729984    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-tls\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.770840 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.770809    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:08.830366 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.830333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.830610 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.830377    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1692b909-5265-40aa-9ad1-5d602ca0fa84-metrics-client-ca\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.830610 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.830524    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-tls\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.830610 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.830598    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-textfile\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.830782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.830686    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-wtmp\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.830782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.830723    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbs6k\" (UniqueName: \"kubernetes.io/projected/1692b909-5265-40aa-9ad1-5d602ca0fa84-kube-api-access-cbs6k\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.830782 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.830751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.830921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.830792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1692b909-5265-40aa-9ad1-5d602ca0fa84-sys\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.830921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.830822    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1692b909-5265-40aa-9ad1-5d602ca0fa84-root\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.830921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.830845    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-textfile\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.830921 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.830906    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1692b909-5265-40aa-9ad1-5d602ca0fa84-sys\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.831084 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.831000    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-wtmp\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.831084 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.831029    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1692b909-5265-40aa-9ad1-5d602ca0fa84-metrics-client-ca\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.831223 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.831088    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1692b909-5265-40aa-9ad1-5d602ca0fa84-root\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.831341 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.831311    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-accelerators-collector-config\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.833390 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.833366    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-tls\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.833541 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.833467    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1692b909-5265-40aa-9ad1-5d602ca0fa84-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.841871 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.841848    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbs6k\" (UniqueName: \"kubernetes.io/projected/1692b909-5265-40aa-9ad1-5d602ca0fa84-kube-api-access-cbs6k\") pod \"node-exporter-8vd4j\" (UID: \"1692b909-5265-40aa-9ad1-5d602ca0fa84\") " pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.870683 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.870611    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:08.966917 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.966876    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8vd4j"
Jul 15 14:32:08.970721 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:08.970687    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:09.182453 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.182403    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:09.278396 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.278343    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:09.536552 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.536468    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:09.682601 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.682573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:09.780485 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.780437    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:09.843541 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.843464    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 14:32:09.875569 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.875523    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 14:32:09.875736 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.875676    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.879809 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.879777    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 14:32:09.879809 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.879800    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 14:32:09.880031 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.880011    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 14:32:09.880196 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.880011    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d2k72\""
Jul 15 14:32:09.880196 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.880112    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 14:32:09.880437 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.880419    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 14:32:09.880863 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.880646    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 14:32:09.880863 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.880681    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 14:32:09.880863 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.880704    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 14:32:09.885853 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.885691    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:09.887405 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.887378    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 14:32:09.937964 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.937924    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-volume\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938158 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.937974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938158 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.938000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938158 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.938036    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938158 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.938064    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938158 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.938088    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-web-config\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938389 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.938177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938389 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.938246    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-out\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938389 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.938279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938389 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.938308    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938585 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.938388    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938585 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.938439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:09.938585 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:09.938468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b66xh\" (UniqueName: \"kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-kube-api-access-b66xh\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039311 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039277    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039320    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-web-config\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039481    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-out\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039786 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039505    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039786 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039532    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039786 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039620    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039786 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039684    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039786 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:32:10.039693    2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 15 14:32:10.039786 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039719    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b66xh\" (UniqueName: \"kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-kube-api-access-b66xh\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.039786 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:32:10.039767    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-main-tls podName:269ac7f5-49f6-4aa0-bd5c-04707389c81e nodeName:}" failed. No retries permitted until 2026-07-15 14:32:10.539745344 +0000 UTC m=+90.432849691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e") : secret "alertmanager-main-tls" not found
Jul 15 14:32:10.040165 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039815    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-volume\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.040165 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.039856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.042416 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.040941    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.042416 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.042090    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.042725 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.042632    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.042836 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.042746    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.042836 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.042789    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.043461 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.043437    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.045105 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.045065    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-out\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.045702 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.045340    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-web-config\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.045702 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.045662    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.045981 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.045957    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.047054 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.047028    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-volume\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.049850 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.049820    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b66xh\" (UniqueName: \"kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-kube-api-access-b66xh\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.057913 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.057890    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:32:10.536325 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.536290    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:10.543592 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.543556    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.546328 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.546299    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:10.789300 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:10.789191    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:32:11.504948 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:11.504909    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:11.608693 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:11.608659    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:11.671968 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:11.671933    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:11.840286 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:11.840199    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:11.840286 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:11.840288    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:11.846817 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:11.846792    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:12.050321 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:12.050289    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:12.094466 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:12.094392    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:12.118781 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:12.118751    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:12.181300 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:12.181259    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:13.373505 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:13.373463    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:13.441530 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:13.441462    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:14.096991 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.096916    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:14.503337 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.503307    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7466f97bb7-rtbr4"]
Jul 15 14:32:14.573763 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.573737    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7466f97bb7-rtbr4"]
Jul 15 14:32:14.573931 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.573837    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.583738 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.583307    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 14:32:14.682463 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.682430    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-serving-cert\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.682463 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.682467    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-oauth-config\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.682697 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.682504    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-config\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.682697 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.682533    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-service-ca\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.682697 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.682570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqd6z\" (UniqueName: \"kubernetes.io/projected/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-kube-api-access-gqd6z\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.682697 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.682683    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-trusted-ca-bundle\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.682862 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.682723    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-oauth-serving-cert\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.784318 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.784217    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-trusted-ca-bundle\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.784318 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.784256    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-oauth-serving-cert\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.784318 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.784319    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-serving-cert\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.784599 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.784344    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-oauth-config\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.784599 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.784387    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-config\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.784599 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.784423    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-service-ca\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.784599 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.784461    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqd6z\" (UniqueName: \"kubernetes.io/projected/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-kube-api-access-gqd6z\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.785262 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.785235    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-oauth-serving-cert\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.785425 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.785336    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-trusted-ca-bundle\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.785425 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.785368    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-config\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.785553 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.785458    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-service-ca\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.787147 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.787104    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-oauth-config\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.787462 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.787417    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-serving-cert\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.798352 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.798327    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqd6z\" (UniqueName: \"kubernetes.io/projected/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-kube-api-access-gqd6z\") pod \"console-7466f97bb7-rtbr4\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") " pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.886302 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.886266    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:14.949681 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:14.949637    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:15.078122 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.078023    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6875b777db-qxrk2" podUID="3cfbf9a0-89ec-410f-9216-611b7c74a7ea" containerName="registry" containerID="cri-o://d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8" gracePeriod=30
Jul 15 14:32:15.321665 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.321633    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:15.414205 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.413661    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 14:32:15.474445 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.474418    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:15.523418 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:32:15.523377    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod269ac7f5_49f6_4aa0_bd5c_04707389c81e.slice/crio-7baa1059df64fa7e809c2bc94399eab4a2a84abe9e981bc788b2a4aa460fc1bf WatchSource:0}: Error finding container 7baa1059df64fa7e809c2bc94399eab4a2a84abe9e981bc788b2a4aa460fc1bf: Status 404 returned error can't find the container with id 7baa1059df64fa7e809c2bc94399eab4a2a84abe9e981bc788b2a4aa460fc1bf
Jul 15 14:32:15.539848 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.539829    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:32:15.571955 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.571935    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7466f97bb7-rtbr4"]
Jul 15 14:32:15.574224 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:32:15.574196    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0dfd3d1_016c_4309_a4bc_1d6e920b57d3.slice/crio-8a84edcd82599d42aa930d9f17487a14bd0df41d67c871c3662f5360f172b683 WatchSource:0}: Error finding container 8a84edcd82599d42aa930d9f17487a14bd0df41d67c871c3662f5360f172b683: Status 404 returned error can't find the container with id 8a84edcd82599d42aa930d9f17487a14bd0df41d67c871c3662f5360f172b683
Jul 15 14:32:15.590248 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.590222    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-bound-sa-token\") pod \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") "
Jul 15 14:32:15.590357 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.590276    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-image-registry-private-configuration\") pod \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") "
Jul 15 14:32:15.590357 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.590303    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2g7dd\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-kube-api-access-2g7dd\") pod \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") "
Jul 15 14:32:15.590452 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.590422    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-trusted-ca\") pod \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") "
Jul 15 14:32:15.590510 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.590455    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-certificates\") pod \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") "
Jul 15 14:32:15.590510 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.590504    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-ca-trust-extracted\") pod \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") "
Jul 15 14:32:15.590605 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.590554    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls\") pod \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") "
Jul 15 14:32:15.590605 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.590583    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-installation-pull-secrets\") pod \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\" (UID: \"3cfbf9a0-89ec-410f-9216-611b7c74a7ea\") "
Jul 15 14:32:15.591028 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.590915    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3cfbf9a0-89ec-410f-9216-611b7c74a7ea" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:32:15.591574 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.591536    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3cfbf9a0-89ec-410f-9216-611b7c74a7ea" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:32:15.593116 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.593089    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-kube-api-access-2g7dd" (OuterVolumeSpecName: "kube-api-access-2g7dd") pod "3cfbf9a0-89ec-410f-9216-611b7c74a7ea" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea"). InnerVolumeSpecName "kube-api-access-2g7dd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:32:15.593274 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.593174    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3cfbf9a0-89ec-410f-9216-611b7c74a7ea" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:32:15.593381 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.593356    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3cfbf9a0-89ec-410f-9216-611b7c74a7ea" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:32:15.593437 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.593384    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3cfbf9a0-89ec-410f-9216-611b7c74a7ea" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:32:15.593437 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.593415    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3cfbf9a0-89ec-410f-9216-611b7c74a7ea" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:32:15.599746 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.599723    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3cfbf9a0-89ec-410f-9216-611b7c74a7ea" (UID: "3cfbf9a0-89ec-410f-9216-611b7c74a7ea"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:32:15.691300 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.691269    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-ca-trust-extracted\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:15.691300 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.691302    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:15.691470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.691312    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-installation-pull-secrets\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:15.691470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.691321    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-bound-sa-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:15.691470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.691330    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-image-registry-private-configuration\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:15.691470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.691339    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2g7dd\" (UniqueName: \"kubernetes.io/projected/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-kube-api-access-2g7dd\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:15.691470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.691347    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-trusted-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:15.691470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:15.691359    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cfbf9a0-89ec-410f-9216-611b7c74a7ea-registry-certificates\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:16.108457 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.108416    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7466f97bb7-rtbr4" event={"ID":"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3","Type":"ContainerStarted","Data":"2d0627849f0eb898096f4055424f1a9ec0d7b1c6e59de6d4536d9baf27dad515"}
Jul 15 14:32:16.108648 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.108480    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7466f97bb7-rtbr4" event={"ID":"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3","Type":"ContainerStarted","Data":"8a84edcd82599d42aa930d9f17487a14bd0df41d67c871c3662f5360f172b683"}
Jul 15 14:32:16.110373 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.110030    2574 generic.go:356] "Generic (PLEG): container finished" podID="3cfbf9a0-89ec-410f-9216-611b7c74a7ea" containerID="d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8" exitCode=0
Jul 15 14:32:16.110373 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.110163    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6875b777db-qxrk2" event={"ID":"3cfbf9a0-89ec-410f-9216-611b7c74a7ea","Type":"ContainerDied","Data":"d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8"}
Jul 15 14:32:16.110373 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.110207    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6875b777db-qxrk2" event={"ID":"3cfbf9a0-89ec-410f-9216-611b7c74a7ea","Type":"ContainerDied","Data":"e70fa2dc5dafd1a9f21180f792f5ec80be58abb4f4446ec133767c10c81f91e9"}
Jul 15 14:32:16.110373 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.110237    2574 scope.go:117] "RemoveContainer" containerID="d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8"
Jul 15 14:32:16.110373 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.110228    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6875b777db-qxrk2"
Jul 15 14:32:16.112964 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.112901    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-9bhfb" event={"ID":"96ea9402-b03e-43f5-8921-dbc6bb916083","Type":"ContainerStarted","Data":"4f83c27b1ed16585ff342dd3efcbaeba1a86d2e0f6a2c34c79246886df323f9f"}
Jul 15 14:32:16.113186 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.113116    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-9bhfb"
Jul 15 14:32:16.116236 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.116166    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerStarted","Data":"7baa1059df64fa7e809c2bc94399eab4a2a84abe9e981bc788b2a4aa460fc1bf"}
Jul 15 14:32:16.117484 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.117460    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vd4j" event={"ID":"1692b909-5265-40aa-9ad1-5d602ca0fa84","Type":"ContainerStarted","Data":"df62feb1355f0b3181d3996be838c927027e23ed093f46f4167be5d077e96441"}
Jul 15 14:32:16.124167 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.124095    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-9bhfb"
Jul 15 14:32:16.128604 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.128562    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7466f97bb7-rtbr4" podStartSLOduration=2.128547237 podStartE2EDuration="2.128547237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:16.127491769 +0000 UTC m=+96.020596136" watchObservedRunningTime="2026-07-15 14:32:16.128547237 +0000 UTC m=+96.021651603"
Jul 15 14:32:16.146400 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.146040    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-9bhfb" podStartSLOduration=1.433481956 podStartE2EDuration="20.146020198s" totalImagesPullingTime="18.712538242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:16.145862379 +0000 UTC m=+96.038966746" watchObservedRunningTime="2026-07-15 14:32:16.146020198 +0000 UTC m=+96.039124565"
Jul 15 14:32:16.171717 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.171656    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6875b777db-qxrk2"]
Jul 15 14:32:16.175248 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.175220    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6875b777db-qxrk2"]
Jul 15 14:32:16.358343 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.358319    2574 scope.go:117] "RemoveContainer" containerID="d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8"
Jul 15 14:32:16.358812 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:32:16.358752    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8\": container with ID starting with d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8 not found: ID does not exist" containerID="d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8"
Jul 15 14:32:16.358907 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.358791    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8"} err="failed to get container status \"d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8\": rpc error: code = NotFound desc = could not find container \"d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8\": container with ID starting with d46f9d01416355b250d4c9f6cefa9787035c9093acd8c6d8156b54c90436a5c8 not found: ID does not exist"
Jul 15 14:32:16.653673 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:16.653637    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cfbf9a0-89ec-410f-9216-611b7c74a7ea" path="/var/lib/kubelet/pods/3cfbf9a0-89ec-410f-9216-611b7c74a7ea/volumes"
Jul 15 14:32:17.127907 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:17.127871    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vd4j" event={"ID":"1692b909-5265-40aa-9ad1-5d602ca0fa84","Type":"ContainerStarted","Data":"892f5b7beeecddbdbc552f48af42eef570dd47522c58c0c28a4f8e3018952134"}
Jul 15 14:32:18.132449 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:18.132360    2574 generic.go:356] "Generic (PLEG): container finished" podID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerID="28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139" exitCode=0
Jul 15 14:32:18.132864 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:18.132453    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerDied","Data":"28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139"}
Jul 15 14:32:18.134290 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:18.134259    2574 generic.go:356] "Generic (PLEG): container finished" podID="1692b909-5265-40aa-9ad1-5d602ca0fa84" containerID="892f5b7beeecddbdbc552f48af42eef570dd47522c58c0c28a4f8e3018952134" exitCode=0
Jul 15 14:32:18.134400 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:18.134347    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vd4j" event={"ID":"1692b909-5265-40aa-9ad1-5d602ca0fa84","Type":"ContainerDied","Data":"892f5b7beeecddbdbc552f48af42eef570dd47522c58c0c28a4f8e3018952134"}
Jul 15 14:32:18.354473 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:18.354436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:18.453302 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:18.453268    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:18.956973 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:18.956937    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:19.062603 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:19.062573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:19.142389 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:19.142351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vd4j" event={"ID":"1692b909-5265-40aa-9ad1-5d602ca0fa84","Type":"ContainerStarted","Data":"b7be31f7ad71ac6edec14c9bbf57d45a274f70d187d8718d0e0bb6a4ee7b5ab8"}
Jul 15 14:32:19.143220 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:19.142412    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8vd4j" event={"ID":"1692b909-5265-40aa-9ad1-5d602ca0fa84","Type":"ContainerStarted","Data":"b36995326ea8f2b27c1f589852db72f501d9d5409b69708c0fb3e9e12435be69"}
Jul 15 14:32:19.199575 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:19.199271    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8vd4j" podStartSLOduration=9.52811922 podStartE2EDuration="11.199250214s" totalImagesPullingTime="1.577387153s" totalInitContainerRuntime="93.743841ms" isStatefulPod=true podCreationTimestamp="2026-07-15 14:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:19.197279679 +0000 UTC m=+99.090384047" watchObservedRunningTime="2026-07-15 14:32:19.199250214 +0000 UTC m=+99.092354580"
Jul 15 14:32:19.325579 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:19.325502    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:19.867092 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:19.866900    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:19.943416 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:19.943378    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:20.196457 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:20.196425    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:20.291393 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:20.291361    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:21.154282 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:21.154248    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerStarted","Data":"3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec"}
Jul 15 14:32:21.154485 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:21.154325    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerStarted","Data":"d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f"}
Jul 15 14:32:21.154485 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:21.154365    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerStarted","Data":"ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def"}
Jul 15 14:32:21.154485 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:21.154402    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerStarted","Data":"3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41"}
Jul 15 14:32:21.154485 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:21.154429    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerStarted","Data":"b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c"}
Jul 15 14:32:23.168336 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:23.168297    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerStarted","Data":"a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5"}
Jul 15 14:32:23.244671 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:23.244603    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.161813201 podStartE2EDuration="14.244585607s" totalImagesPullingTime="6.064937145s" totalInitContainerRuntime="17.835261ms" isStatefulPod=false podCreationTimestamp="2026-07-15 14:32:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:32:23.243281433 +0000 UTC m=+103.136385801" watchObservedRunningTime="2026-07-15 14:32:23.244585607 +0000 UTC m=+103.137689974"
Jul 15 14:32:24.516630 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:24.516594    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:24.617153 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:24.617100    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:24.886436 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:24.886337    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:24.886436 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:24.886412    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:24.892676 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:24.892648    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:25.180298 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:25.180249    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:32:25.239436 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:25.239394    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-795b9b9c94-kr5gx"]
Jul 15 14:32:25.363978 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:25.363947    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:25.464654 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:25.464563    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:25.569709 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:25.569683    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:27.017461 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:27.017428    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9swdm"
Jul 15 14:32:28.191571 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:28.191537    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:28.291669 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:28.291635    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:33.338706 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:33.338671    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:33.438309 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:33.438276    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:48.358462 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:48.358423    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:48.426975 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:48.426941    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:32:50.266765 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.266720    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-795b9b9c94-kr5gx" podUID="b76644ba-3f36-4723-8437-10dcc3eae3e5" containerName="console" containerID="cri-o://3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0" gracePeriod=15
Jul 15 14:32:50.553987 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.553961    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:50.702774 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.702735    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-oauth-serving-cert\") pod \"b76644ba-3f36-4723-8437-10dcc3eae3e5\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") "
Jul 15 14:32:50.702774 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.702780    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-serving-cert\") pod \"b76644ba-3f36-4723-8437-10dcc3eae3e5\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") "
Jul 15 14:32:50.703017 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.702809    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-oauth-config\") pod \"b76644ba-3f36-4723-8437-10dcc3eae3e5\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") "
Jul 15 14:32:50.703017 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.702839    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsk6n\" (UniqueName: \"kubernetes.io/projected/b76644ba-3f36-4723-8437-10dcc3eae3e5-kube-api-access-fsk6n\") pod \"b76644ba-3f36-4723-8437-10dcc3eae3e5\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") "
Jul 15 14:32:50.703017 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.702873    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-config\") pod \"b76644ba-3f36-4723-8437-10dcc3eae3e5\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") "
Jul 15 14:32:50.703017 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.702904    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-service-ca\") pod \"b76644ba-3f36-4723-8437-10dcc3eae3e5\" (UID: \"b76644ba-3f36-4723-8437-10dcc3eae3e5\") "
Jul 15 14:32:50.703312 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.703275    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b76644ba-3f36-4723-8437-10dcc3eae3e5" (UID: "b76644ba-3f36-4723-8437-10dcc3eae3e5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:32:50.703403 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.703341    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-config" (OuterVolumeSpecName: "console-config") pod "b76644ba-3f36-4723-8437-10dcc3eae3e5" (UID: "b76644ba-3f36-4723-8437-10dcc3eae3e5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:32:50.703403 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.703356    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-service-ca" (OuterVolumeSpecName: "service-ca") pod "b76644ba-3f36-4723-8437-10dcc3eae3e5" (UID: "b76644ba-3f36-4723-8437-10dcc3eae3e5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:32:50.705150 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.705110    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b76644ba-3f36-4723-8437-10dcc3eae3e5" (UID: "b76644ba-3f36-4723-8437-10dcc3eae3e5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:32:50.705416 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.705393    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b76644ba-3f36-4723-8437-10dcc3eae3e5" (UID: "b76644ba-3f36-4723-8437-10dcc3eae3e5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:32:50.705479 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.705406    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b76644ba-3f36-4723-8437-10dcc3eae3e5-kube-api-access-fsk6n" (OuterVolumeSpecName: "kube-api-access-fsk6n") pod "b76644ba-3f36-4723-8437-10dcc3eae3e5" (UID: "b76644ba-3f36-4723-8437-10dcc3eae3e5"). InnerVolumeSpecName "kube-api-access-fsk6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:32:50.803502 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.803433    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-oauth-config\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:50.803502 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.803456    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsk6n\" (UniqueName: \"kubernetes.io/projected/b76644ba-3f36-4723-8437-10dcc3eae3e5-kube-api-access-fsk6n\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:50.803502 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.803467    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-config\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:50.803502 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.803477    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:50.803502 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.803484    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b76644ba-3f36-4723-8437-10dcc3eae3e5-oauth-serving-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:50.803502 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:50.803493    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b76644ba-3f36-4723-8437-10dcc3eae3e5-console-serving-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:32:51.270323 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:51.270285    2574 generic.go:356] "Generic (PLEG): container finished" podID="b76644ba-3f36-4723-8437-10dcc3eae3e5" containerID="3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0" exitCode=0
Jul 15 14:32:51.270802 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:51.270341    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-795b9b9c94-kr5gx"
Jul 15 14:32:51.270802 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:51.270370    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795b9b9c94-kr5gx" event={"ID":"b76644ba-3f36-4723-8437-10dcc3eae3e5","Type":"ContainerDied","Data":"3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0"}
Jul 15 14:32:51.270802 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:51.270422    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-795b9b9c94-kr5gx" event={"ID":"b76644ba-3f36-4723-8437-10dcc3eae3e5","Type":"ContainerDied","Data":"7ced035d2547c952a99b57f2cb89d0303877e6b971b73c12f53c63c02686cbc2"}
Jul 15 14:32:51.270802 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:51.270441    2574 scope.go:117] "RemoveContainer" containerID="3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0"
Jul 15 14:32:51.278890 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:51.278877    2574 scope.go:117] "RemoveContainer" containerID="3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0"
Jul 15 14:32:51.279197 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:32:51.279168    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0\": container with ID starting with 3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0 not found: ID does not exist" containerID="3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0"
Jul 15 14:32:51.279288 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:51.279206    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0"} err="failed to get container status \"3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0\": rpc error: code = NotFound desc = could not find container \"3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0\": container with ID starting with 3d0402e4a66e68ad2027f1704018f5ce4da9f3a5c784d191f123b5436dd8d6d0 not found: ID does not exist"
Jul 15 14:32:51.294167 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:51.294144    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-795b9b9c94-kr5gx"]
Jul 15 14:32:51.302523 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:51.302502    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-795b9b9c94-kr5gx"]
Jul 15 14:32:52.651309 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:32:52.651279    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b76644ba-3f36-4723-8437-10dcc3eae3e5" path="/var/lib/kubelet/pods/b76644ba-3f36-4723-8437-10dcc3eae3e5/volumes"
Jul 15 14:33:27.929404 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:27.929367    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:33:28.194825 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:28.194737    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:33:29.042445 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.042409    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 14:33:29.042823 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.042711    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="alertmanager" containerID="cri-o://b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c" gracePeriod=120
Jul 15 14:33:29.042823 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.042773    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy-metric" containerID="cri-o://3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec" gracePeriod=120
Jul 15 14:33:29.042934 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.042822    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy-web" containerID="cri-o://ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def" gracePeriod=120
Jul 15 14:33:29.042934 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.042848    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="prom-label-proxy" containerID="cri-o://a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5" gracePeriod=120
Jul 15 14:33:29.042934 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.042866    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="config-reloader" containerID="cri-o://3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41" gracePeriod=120
Jul 15 14:33:29.043080 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.042866    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy" containerID="cri-o://d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f" gracePeriod=120
Jul 15 14:33:29.410325 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.410295    2574 generic.go:356] "Generic (PLEG): container finished" podID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerID="a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5" exitCode=0
Jul 15 14:33:29.410325 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.410321    2574 generic.go:356] "Generic (PLEG): container finished" podID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerID="d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f" exitCode=0
Jul 15 14:33:29.410325 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.410330    2574 generic.go:356] "Generic (PLEG): container finished" podID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerID="3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41" exitCode=0
Jul 15 14:33:29.410590 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.410338    2574 generic.go:356] "Generic (PLEG): container finished" podID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerID="b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c" exitCode=0
Jul 15 14:33:29.410590 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.410364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerDied","Data":"a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5"}
Jul 15 14:33:29.410590 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.410446    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerDied","Data":"d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f"}
Jul 15 14:33:29.410590 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.410491    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerDied","Data":"3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41"}
Jul 15 14:33:29.410590 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:29.410520    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerDied","Data":"b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c"}
Jul 15 14:33:30.279268 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.279246    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.407776 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.407743    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-metrics-client-ca\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.407950 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.407782    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-main-tls\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.407950 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.407822    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-tls-assets\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.407950 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.407843    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.407950 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.407868    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-volume\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.407950 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.407909    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-web\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.407950 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.407932    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.408277 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.407960    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-out\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.408277 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.407992    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-web-config\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.408277 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.408027    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-trusted-ca-bundle\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.408277 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.408074    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-main-db\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.408277 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.408111    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-cluster-tls-config\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.408277 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.408164    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b66xh\" (UniqueName: \"kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-kube-api-access-b66xh\") pod \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\" (UID: \"269ac7f5-49f6-4aa0-bd5c-04707389c81e\") "
Jul 15 14:33:30.408277 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.408177    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:33:30.408583 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.408365    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-metrics-client-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.408583 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.408538    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:33:30.408904 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.408877    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:33:30.411493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.410700    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:33:30.411493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.411122    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-volume" (OuterVolumeSpecName: "config-volume") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:33:30.411493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.411433    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-kube-api-access-b66xh" (OuterVolumeSpecName: "kube-api-access-b66xh") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "kube-api-access-b66xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:33:30.412054 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.412028    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:33:30.412191 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.412112    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:33:30.412288 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.412266    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-out" (OuterVolumeSpecName: "config-out") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:33:30.412592 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.412569    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:33:30.412700 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.412652    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:33:30.415765 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.415743    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:33:30.418499 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.418472    2574 generic.go:356] "Generic (PLEG): container finished" podID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerID="3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec" exitCode=0
Jul 15 14:33:30.418571 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.418501    2574 generic.go:356] "Generic (PLEG): container finished" podID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerID="ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def" exitCode=0
Jul 15 14:33:30.418571 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.418533    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerDied","Data":"3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec"}
Jul 15 14:33:30.418646 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.418575    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.418679 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.418659    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerDied","Data":"ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def"}
Jul 15 14:33:30.418723 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.418709    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"269ac7f5-49f6-4aa0-bd5c-04707389c81e","Type":"ContainerDied","Data":"7baa1059df64fa7e809c2bc94399eab4a2a84abe9e981bc788b2a4aa460fc1bf"}
Jul 15 14:33:30.418760 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.418726    2574 scope.go:117] "RemoveContainer" containerID="a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5"
Jul 15 14:33:30.422706 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.422684    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-web-config" (OuterVolumeSpecName: "web-config") pod "269ac7f5-49f6-4aa0-bd5c-04707389c81e" (UID: "269ac7f5-49f6-4aa0-bd5c-04707389c81e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:33:30.426106 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.426091    2574 scope.go:117] "RemoveContainer" containerID="3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec"
Jul 15 14:33:30.432479 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.432459    2574 scope.go:117] "RemoveContainer" containerID="d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f"
Jul 15 14:33:30.438580 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.438565    2574 scope.go:117] "RemoveContainer" containerID="ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def"
Jul 15 14:33:30.444719 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.444703    2574 scope.go:117] "RemoveContainer" containerID="3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41"
Jul 15 14:33:30.450901 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.450887    2574 scope.go:117] "RemoveContainer" containerID="b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c"
Jul 15 14:33:30.457244 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.457206    2574 scope.go:117] "RemoveContainer" containerID="28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139"
Jul 15 14:33:30.463918 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.463903    2574 scope.go:117] "RemoveContainer" containerID="a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5"
Jul 15 14:33:30.464222 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:33:30.464204    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5\": container with ID starting with a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5 not found: ID does not exist" containerID="a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5"
Jul 15 14:33:30.464284 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.464230    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5"} err="failed to get container status \"a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5\": rpc error: code = NotFound desc = could not find container \"a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5\": container with ID starting with a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5 not found: ID does not exist"
Jul 15 14:33:30.464284 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.464249    2574 scope.go:117] "RemoveContainer" containerID="3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec"
Jul 15 14:33:30.464480 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:33:30.464459    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec\": container with ID starting with 3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec not found: ID does not exist" containerID="3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec"
Jul 15 14:33:30.464521 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.464488    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec"} err="failed to get container status \"3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec\": rpc error: code = NotFound desc = could not find container \"3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec\": container with ID starting with 3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec not found: ID does not exist"
Jul 15 14:33:30.464521 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.464505    2574 scope.go:117] "RemoveContainer" containerID="d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f"
Jul 15 14:33:30.464744 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:33:30.464727    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f\": container with ID starting with d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f not found: ID does not exist" containerID="d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f"
Jul 15 14:33:30.464852 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.464752    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f"} err="failed to get container status \"d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f\": rpc error: code = NotFound desc = could not find container \"d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f\": container with ID starting with d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f not found: ID does not exist"
Jul 15 14:33:30.464852 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.464772    2574 scope.go:117] "RemoveContainer" containerID="ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def"
Jul 15 14:33:30.464990 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:33:30.464974    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def\": container with ID starting with ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def not found: ID does not exist" containerID="ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def"
Jul 15 14:33:30.465028 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.464992    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def"} err="failed to get container status \"ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def\": rpc error: code = NotFound desc = could not find container \"ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def\": container with ID starting with ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def not found: ID does not exist"
Jul 15 14:33:30.465028 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.465005    2574 scope.go:117] "RemoveContainer" containerID="3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41"
Jul 15 14:33:30.465266 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:33:30.465250    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41\": container with ID starting with 3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41 not found: ID does not exist" containerID="3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41"
Jul 15 14:33:30.465327 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.465269    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41"} err="failed to get container status \"3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41\": rpc error: code = NotFound desc = could not find container \"3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41\": container with ID starting with 3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41 not found: ID does not exist"
Jul 15 14:33:30.465327 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.465281    2574 scope.go:117] "RemoveContainer" containerID="b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c"
Jul 15 14:33:30.465501 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:33:30.465484    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c\": container with ID starting with b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c not found: ID does not exist" containerID="b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c"
Jul 15 14:33:30.465542 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.465505    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c"} err="failed to get container status \"b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c\": rpc error: code = NotFound desc = could not find container \"b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c\": container with ID starting with b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c not found: ID does not exist"
Jul 15 14:33:30.465542 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.465519    2574 scope.go:117] "RemoveContainer" containerID="28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139"
Jul 15 14:33:30.465748 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:33:30.465732    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139\": container with ID starting with 28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139 not found: ID does not exist" containerID="28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139"
Jul 15 14:33:30.465811 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.465755    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139"} err="failed to get container status \"28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139\": rpc error: code = NotFound desc = could not find container \"28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139\": container with ID starting with 28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139 not found: ID does not exist"
Jul 15 14:33:30.465811 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.465777    2574 scope.go:117] "RemoveContainer" containerID="a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5"
Jul 15 14:33:30.465994 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.465978    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5"} err="failed to get container status \"a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5\": rpc error: code = NotFound desc = could not find container \"a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5\": container with ID starting with a5e43e64b1d62ad227ac6e4927ba8ed1c3778803251c755654a9e188cc37eaf5 not found: ID does not exist"
Jul 15 14:33:30.466038 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.465994    2574 scope.go:117] "RemoveContainer" containerID="3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec"
Jul 15 14:33:30.466243 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.466225    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec"} err="failed to get container status \"3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec\": rpc error: code = NotFound desc = could not find container \"3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec\": container with ID starting with 3b1b74b1a6ac2c6eda7d19d57adb760505465ac823c3603e320a54e3a0a9a9ec not found: ID does not exist"
Jul 15 14:33:30.466288 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.466244    2574 scope.go:117] "RemoveContainer" containerID="d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f"
Jul 15 14:33:30.466504 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.466485    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f"} err="failed to get container status \"d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f\": rpc error: code = NotFound desc = could not find container \"d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f\": container with ID starting with d5394c7d6d3f753f43fbd7c5cec5adb1de7096dee21a473b7483051a38ea729f not found: ID does not exist"
Jul 15 14:33:30.466573 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.466506    2574 scope.go:117] "RemoveContainer" containerID="ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def"
Jul 15 14:33:30.466716 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.466699    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def"} err="failed to get container status \"ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def\": rpc error: code = NotFound desc = could not find container \"ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def\": container with ID starting with ea043fd0e13fef7d488588ac944d378f21dd11db7dc366434e9761c224434def not found: ID does not exist"
Jul 15 14:33:30.466781 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.466716    2574 scope.go:117] "RemoveContainer" containerID="3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41"
Jul 15 14:33:30.466913 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.466895    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41"} err="failed to get container status \"3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41\": rpc error: code = NotFound desc = could not find container \"3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41\": container with ID starting with 3342a1eda64d03ca983f6601350a11fdb81d88b78e77657d04fbdd0609557f41 not found: ID does not exist"
Jul 15 14:33:30.466967 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.466913    2574 scope.go:117] "RemoveContainer" containerID="b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c"
Jul 15 14:33:30.467109 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.467090    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c"} err="failed to get container status \"b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c\": rpc error: code = NotFound desc = could not find container \"b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c\": container with ID starting with b1437e95fe288a68f87392cb97adee36900e3438000fbb0e062a9a52d865612c not found: ID does not exist"
Jul 15 14:33:30.467109 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.467107    2574 scope.go:117] "RemoveContainer" containerID="28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139"
Jul 15 14:33:30.467315 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.467295    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139"} err="failed to get container status \"28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139\": rpc error: code = NotFound desc = could not find container \"28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139\": container with ID starting with 28d1cdb8eb18f916a1df7d35363a27a8f45b7fe9c6e63c66bc6b6be5b7105139 not found: ID does not exist"
Jul 15 14:33:30.509415 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509385    2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.509415 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509411    2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-alertmanager-main-db\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.509415 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509422    2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-cluster-tls-config\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.509596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509431    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b66xh\" (UniqueName: \"kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-kube-api-access-b66xh\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.509596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509440    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-main-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.509596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509449    2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/269ac7f5-49f6-4aa0-bd5c-04707389c81e-tls-assets\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.509596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509457    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.509596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509465    2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-volume\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.509596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509474    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.509596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509483    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.509596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509493    2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/269ac7f5-49f6-4aa0-bd5c-04707389c81e-config-out\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.509596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.509501    2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/269ac7f5-49f6-4aa0-bd5c-04707389c81e-web-config\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:33:30.743433 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.743401    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 14:33:30.747087 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.747065    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 14:33:30.788690 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.788658    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 14:33:30.788945 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.788929    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy"
Jul 15 14:33:30.789026 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.788947    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy"
Jul 15 14:33:30.789026 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.788971    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cfbf9a0-89ec-410f-9216-611b7c74a7ea" containerName="registry"
Jul 15 14:33:30.789026 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.788980    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cfbf9a0-89ec-410f-9216-611b7c74a7ea" containerName="registry"
Jul 15 14:33:30.789026 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.788988    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="config-reloader"
Jul 15 14:33:30.789026 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.788997    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="config-reloader"
Jul 15 14:33:30.789026 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789006    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy-web"
Jul 15 14:33:30.789026 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789014    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy-web"
Jul 15 14:33:30.789026 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789025    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b76644ba-3f36-4723-8437-10dcc3eae3e5" containerName="console"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789033    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b76644ba-3f36-4723-8437-10dcc3eae3e5" containerName="console"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789043    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="init-config-reloader"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789051    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="init-config-reloader"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789062    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="alertmanager"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789070    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="alertmanager"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789079    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy-metric"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789087    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy-metric"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789095    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="prom-label-proxy"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789103    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="prom-label-proxy"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789214    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="config-reloader"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789225    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789238    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cfbf9a0-89ec-410f-9216-611b7c74a7ea" containerName="registry"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789264    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b76644ba-3f36-4723-8437-10dcc3eae3e5" containerName="console"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789272    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy-web"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789281    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="kube-rbac-proxy-metric"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789289    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="alertmanager"
Jul 15 14:33:30.789456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.789296    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" containerName="prom-label-proxy"
Jul 15 14:33:30.792976 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.792956    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.797602 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.797582    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 14:33:30.797760 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.797621    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 14:33:30.797760 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.797648    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 14:33:30.800608 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.800359    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 14:33:30.800608 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.800553    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 14:33:30.800608 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.800575    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 14:33:30.800799 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.800781    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 14:33:30.800978 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.800957    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 14:33:30.801457 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.801217    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-d2k72\""
Jul 15 14:33:30.805018 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.805003    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 14:33:30.888644 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.888609    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 14:33:30.913628 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913552    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-config-volume\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.913628 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/744371be-6c26-460c-b748-e89937c4dff2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.913628 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913615    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.913877 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913705    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.913877 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913744    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/744371be-6c26-460c-b748-e89937c4dff2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.913877 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913769    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k58l8\" (UniqueName: \"kubernetes.io/projected/744371be-6c26-460c-b748-e89937c4dff2-kube-api-access-k58l8\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.913877 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913830    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.913877 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913856    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/744371be-6c26-460c-b748-e89937c4dff2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.913877 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/744371be-6c26-460c-b748-e89937c4dff2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.914083 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913896    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.914083 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913919    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/744371be-6c26-460c-b748-e89937c4dff2-config-out\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.914083 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913938    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-web-config\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:30.914083 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:30.913978    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014711 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014657    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/744371be-6c26-460c-b748-e89937c4dff2-config-out\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014711 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-web-config\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014739    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-config-volume\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/744371be-6c26-460c-b748-e89937c4dff2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014797    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014814    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/744371be-6c26-460c-b748-e89937c4dff2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014848    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k58l8\" (UniqueName: \"kubernetes.io/projected/744371be-6c26-460c-b748-e89937c4dff2-kube-api-access-k58l8\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014901    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/744371be-6c26-460c-b748-e89937c4dff2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014926    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/744371be-6c26-460c-b748-e89937c4dff2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.014958 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.014958    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.015529 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.015273    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/744371be-6c26-460c-b748-e89937c4dff2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.015969 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.015944    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/744371be-6c26-460c-b748-e89937c4dff2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.017893 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.017864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.017995 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.017865    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.017995 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.017936    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/744371be-6c26-460c-b748-e89937c4dff2-config-out\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.017995 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.017963    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-web-config\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.018183 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.018054    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-config-volume\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.018183 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.018075    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.018183 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.018082    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.018670 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.018651    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/744371be-6c26-460c-b748-e89937c4dff2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.018745 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.018724    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/744371be-6c26-460c-b748-e89937c4dff2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.019675 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.019660    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/744371be-6c26-460c-b748-e89937c4dff2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.032455 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.032433    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k58l8\" (UniqueName: \"kubernetes.io/projected/744371be-6c26-460c-b748-e89937c4dff2-kube-api-access-k58l8\") pod \"alertmanager-main-0\" (UID: \"744371be-6c26-460c-b748-e89937c4dff2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.104535 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.104512    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 14:33:31.266677 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.266644    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 14:33:31.267280 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:33:31.267255    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744371be_6c26_460c_b748_e89937c4dff2.slice/crio-95dc7017796a42b2f2d7599420649ef5844c80f1fc31690b48c10ca19e88e761 WatchSource:0}: Error finding container 95dc7017796a42b2f2d7599420649ef5844c80f1fc31690b48c10ca19e88e761: Status 404 returned error can't find the container with id 95dc7017796a42b2f2d7599420649ef5844c80f1fc31690b48c10ca19e88e761
Jul 15 14:33:31.423842 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.423808    2574 generic.go:356] "Generic (PLEG): container finished" podID="744371be-6c26-460c-b748-e89937c4dff2" containerID="6752797b44e0f5777f85484f548073cf9c6c9a2a42be8a4cfe738f25b8fff818" exitCode=0
Jul 15 14:33:31.424325 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.423886    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"744371be-6c26-460c-b748-e89937c4dff2","Type":"ContainerDied","Data":"6752797b44e0f5777f85484f548073cf9c6c9a2a42be8a4cfe738f25b8fff818"}
Jul 15 14:33:31.424325 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.423965    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"744371be-6c26-460c-b748-e89937c4dff2","Type":"ContainerStarted","Data":"95dc7017796a42b2f2d7599420649ef5844c80f1fc31690b48c10ca19e88e761"}
Jul 15 14:33:31.586793 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:31.586767    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:33:32.431074 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:32.431036    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"744371be-6c26-460c-b748-e89937c4dff2","Type":"ContainerStarted","Data":"eec9861105cef94f22c037b3d3b03233306dcd067476e0ea91fb230f2b0db908"}
Jul 15 14:33:32.431463 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:32.431118    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"744371be-6c26-460c-b748-e89937c4dff2","Type":"ContainerStarted","Data":"504b8d9e536a813475a251c96fdcd0c89973db420c33a8fc3bec4362c640ad89"}
Jul 15 14:33:32.431463 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:32.431180    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"744371be-6c26-460c-b748-e89937c4dff2","Type":"ContainerStarted","Data":"b3cd61f35ea3c96f02ff34acc32e3f80026b7d3edbf107aaa1758078bfbe524f"}
Jul 15 14:33:32.431463 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:32.431215    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"744371be-6c26-460c-b748-e89937c4dff2","Type":"ContainerStarted","Data":"53f0fc7972577bc50ba4edbb37ab8d8f39c4ff262ddbda316a8c3e9a792f92ec"}
Jul 15 14:33:32.431463 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:32.431249    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"744371be-6c26-460c-b748-e89937c4dff2","Type":"ContainerStarted","Data":"91e03a27a0de9d83cfecd542b0544ef910dfaae9fec1a425ebc4d7cf66c00928"}
Jul 15 14:33:32.431463 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:32.431289    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"744371be-6c26-460c-b748-e89937c4dff2","Type":"ContainerStarted","Data":"dee24929b26f19002ea74c3e016eab1fa7ad248d2de9c8d064233beef2227148"}
Jul 15 14:33:32.461512 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:32.461464    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.448110878 podStartE2EDuration="2.461447303s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.336425ms" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:33:32.460055286 +0000 UTC m=+172.353159682" watchObservedRunningTime="2026-07-15 14:33:32.461447303 +0000 UTC m=+172.354551669"
Jul 15 14:33:32.651973 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:32.651933    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="269ac7f5-49f6-4aa0-bd5c-04707389c81e" path="/var/lib/kubelet/pods/269ac7f5-49f6-4aa0-bd5c-04707389c81e/volumes"
Jul 15 14:33:33.050956 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.050920    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-54d96b664d-9hl8j"]
Jul 15 14:33:33.053690 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.053670    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.056560 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.056532    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 15 14:33:33.056696 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.056573    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 15 14:33:33.056696 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.056532    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 15 14:33:33.056696 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.056573    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f6hpz\""
Jul 15 14:33:33.056696 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.056666    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 15 14:33:33.057145 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.057112    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 15 14:33:33.063591 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.063562    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 15 14:33:33.070810 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.070786    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54d96b664d-9hl8j"]
Jul 15 14:33:33.133954 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.133909    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8309a9a-a177-4907-bc77-243e9b8e0f8c-serving-certs-ca-bundle\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.134119 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.133966    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-secret-telemeter-client\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.134119 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.134030    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7kln\" (UniqueName: \"kubernetes.io/projected/e8309a9a-a177-4907-bc77-243e9b8e0f8c-kube-api-access-h7kln\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.134119 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.134052    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-federate-client-tls\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.134119 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.134072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8309a9a-a177-4907-bc77-243e9b8e0f8c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.134313 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.134125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8309a9a-a177-4907-bc77-243e9b8e0f8c-metrics-client-ca\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.134313 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.134170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.134313 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.134205    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-telemeter-client-tls\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.235351 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.235301    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-federate-client-tls\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.235559 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.235361    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8309a9a-a177-4907-bc77-243e9b8e0f8c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.235559 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.235412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8309a9a-a177-4907-bc77-243e9b8e0f8c-metrics-client-ca\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.235559 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.235450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.235559 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.235509    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-telemeter-client-tls\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.235559 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.235545    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8309a9a-a177-4907-bc77-243e9b8e0f8c-serving-certs-ca-bundle\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.235824 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.235569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-secret-telemeter-client\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.235824 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.235602    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7kln\" (UniqueName: \"kubernetes.io/projected/e8309a9a-a177-4907-bc77-243e9b8e0f8c-kube-api-access-h7kln\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.236293 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.236261    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8309a9a-a177-4907-bc77-243e9b8e0f8c-metrics-client-ca\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.236450 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.236422    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8309a9a-a177-4907-bc77-243e9b8e0f8c-serving-certs-ca-bundle\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.236575 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.236372    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8309a9a-a177-4907-bc77-243e9b8e0f8c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.238035 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.238008    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-federate-client-tls\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.238353 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.238333    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.238437 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.238364    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-secret-telemeter-client\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.238487 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.238434    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e8309a9a-a177-4907-bc77-243e9b8e0f8c-telemeter-client-tls\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.244560 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.244538    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7kln\" (UniqueName: \"kubernetes.io/projected/e8309a9a-a177-4907-bc77-243e9b8e0f8c-kube-api-access-h7kln\") pod \"telemeter-client-54d96b664d-9hl8j\" (UID: \"e8309a9a-a177-4907-bc77-243e9b8e0f8c\") " pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.364512 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.364422    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j"
Jul 15 14:33:33.541311 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:33.541280    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54d96b664d-9hl8j"]
Jul 15 14:33:33.544487 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:33:33.544460    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8309a9a_a177_4907_bc77_243e9b8e0f8c.slice/crio-3cefad230b1c6ea9779d06937947b616a8f52325e82e624b0c68a0c010bea708 WatchSource:0}: Error finding container 3cefad230b1c6ea9779d06937947b616a8f52325e82e624b0c68a0c010bea708: Status 404 returned error can't find the container with id 3cefad230b1c6ea9779d06937947b616a8f52325e82e624b0c68a0c010bea708
Jul 15 14:33:34.440713 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:34.440679    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j" event={"ID":"e8309a9a-a177-4907-bc77-243e9b8e0f8c","Type":"ContainerStarted","Data":"3cefad230b1c6ea9779d06937947b616a8f52325e82e624b0c68a0c010bea708"}
Jul 15 14:33:36.449872 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:36.449839    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j" event={"ID":"e8309a9a-a177-4907-bc77-243e9b8e0f8c","Type":"ContainerStarted","Data":"dcc7824159f353a77bd32087dd0f5206198fe5682b010a9523c5236d7eef1b17"}
Jul 15 14:33:36.450268 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:36.449899    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j" event={"ID":"e8309a9a-a177-4907-bc77-243e9b8e0f8c","Type":"ContainerStarted","Data":"8d75fefd861ed45042bf911f8b81943a445f0aa186b23d4b4352b8d2321ef7a5"}
Jul 15 14:33:36.450268 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:36.449917    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j" event={"ID":"e8309a9a-a177-4907-bc77-243e9b8e0f8c","Type":"ContainerStarted","Data":"ad1f839bcc06be5f1cdb6753ea4c6c498b9326fefbf217d7f1f80e2f714ee69d"}
Jul 15 14:33:36.475450 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:36.475379    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-54d96b664d-9hl8j" podStartSLOduration=0.970263138 podStartE2EDuration="3.475360693s" totalImagesPullingTime="2.505097555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:33:36.475103097 +0000 UTC m=+176.368207463" watchObservedRunningTime="2026-07-15 14:33:36.475360693 +0000 UTC m=+176.368465060"
Jul 15 14:33:37.553600 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:37.553560    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:33:37.639080 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:37.639043    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:33:40.926694 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:40.926659    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:33:48.351749 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:48.351717    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7466f97bb7-rtbr4"]
Jul 15 14:33:48.501177 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:48.501125    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:33:48.602106 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:48.602024    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:33:48.701600 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:48.701569    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:33:49.127585 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:33:49.127550    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:04.240476 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:04.240441    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:13.371381 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.371315    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7466f97bb7-rtbr4" podUID="f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" containerName="console" containerID="cri-o://2d0627849f0eb898096f4055424f1a9ec0d7b1c6e59de6d4536d9baf27dad515" gracePeriod=15
Jul 15 14:34:13.594075 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.594044    2574 generic.go:356] "Generic (PLEG): container finished" podID="f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" containerID="2d0627849f0eb898096f4055424f1a9ec0d7b1c6e59de6d4536d9baf27dad515" exitCode=0
Jul 15 14:34:13.594230 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.594120    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7466f97bb7-rtbr4" event={"ID":"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3","Type":"ContainerDied","Data":"2d0627849f0eb898096f4055424f1a9ec0d7b1c6e59de6d4536d9baf27dad515"}
Jul 15 14:34:13.617242 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.617217    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:34:13.658683 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.658658    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-oauth-serving-cert\") pod \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") "
Jul 15 14:34:13.658872 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.658731    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-config\") pod \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") "
Jul 15 14:34:13.658872 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.658768    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqd6z\" (UniqueName: \"kubernetes.io/projected/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-kube-api-access-gqd6z\") pod \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") "
Jul 15 14:34:13.658872 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.658803    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-serving-cert\") pod \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") "
Jul 15 14:34:13.658872 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.658832    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-service-ca\") pod \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") "
Jul 15 14:34:13.659074 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.658881    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-trusted-ca-bundle\") pod \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") "
Jul 15 14:34:13.659074 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.658907    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-oauth-config\") pod \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\" (UID: \"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3\") "
Jul 15 14:34:13.659074 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.659037    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" (UID: "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:34:13.659243 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.659220    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-config" (OuterVolumeSpecName: "console-config") pod "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" (UID: "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:34:13.659326 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.659301    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" (UID: "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:34:13.659384 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.659330    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" (UID: "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:34:13.661007 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.660980    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" (UID: "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:34:13.661421 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.661389    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-kube-api-access-gqd6z" (OuterVolumeSpecName: "kube-api-access-gqd6z") pod "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" (UID: "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3"). InnerVolumeSpecName "kube-api-access-gqd6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:34:13.661518 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.661426    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" (UID: "f0dfd3d1-016c-4309-a4bc-1d6e920b57d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:34:13.760046 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.759991    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-trusted-ca-bundle\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:34:13.760046 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.760024    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-oauth-config\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:34:13.760330 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.760056    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-oauth-serving-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:34:13.760330 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.760078    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-config\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:34:13.760330 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.760088    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqd6z\" (UniqueName: \"kubernetes.io/projected/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-kube-api-access-gqd6z\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:34:13.760330 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.760102    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-console-serving-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:34:13.760330 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:13.760113    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:34:14.599306 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:14.599262    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7466f97bb7-rtbr4" event={"ID":"f0dfd3d1-016c-4309-a4bc-1d6e920b57d3","Type":"ContainerDied","Data":"8a84edcd82599d42aa930d9f17487a14bd0df41d67c871c3662f5360f172b683"}
Jul 15 14:34:14.599306 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:14.599284    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7466f97bb7-rtbr4"
Jul 15 14:34:14.599807 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:14.599325    2574 scope.go:117] "RemoveContainer" containerID="2d0627849f0eb898096f4055424f1a9ec0d7b1c6e59de6d4536d9baf27dad515"
Jul 15 14:34:14.624425 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:14.624396    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7466f97bb7-rtbr4"]
Jul 15 14:34:14.627568 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:14.627546    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7466f97bb7-rtbr4"]
Jul 15 14:34:14.650934 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:14.650910    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" path="/var/lib/kubelet/pods/f0dfd3d1-016c-4309-a4bc-1d6e920b57d3/volumes"
Jul 15 14:34:23.313400 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:23.313364    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:24.754629 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:24.754596    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:43.276529 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:43.276492    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:43.341461 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:43.341429    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:45.688281 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.688248    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5697cf8ddc-hmdbb"]
Jul 15 14:34:45.688647 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.688498    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" containerName="console"
Jul 15 14:34:45.688647 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.688507    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" containerName="console"
Jul 15 14:34:45.688647 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.688560    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0dfd3d1-016c-4309-a4bc-1d6e920b57d3" containerName="console"
Jul 15 14:34:45.692712 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.692696    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.697376 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.697349    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 14:34:45.697506 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.697456    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 14:34:45.697602 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.697587    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 14:34:45.698286 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.698268    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 14:34:45.701492 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.701470    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 14:34:45.701653 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.701636    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8czzb\""
Jul 15 14:34:45.707432 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.707412    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 14:34:45.714190 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.714170    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5697cf8ddc-hmdbb"]
Jul 15 14:34:45.758203 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.758168    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:45.797100 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.797069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-config\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.797243 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.797107    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-service-ca\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.797243 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.797198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-oauth-serving-cert\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.797243 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.797219    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j294r\" (UniqueName: \"kubernetes.io/projected/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-kube-api-access-j294r\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.797338 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.797295    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-oauth-config\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.797338 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.797329    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-serving-cert\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.797402 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.797348    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-trusted-ca-bundle\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.846920 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.846892    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:45.898566 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.898538    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-oauth-serving-cert\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.898566 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.898568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j294r\" (UniqueName: \"kubernetes.io/projected/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-kube-api-access-j294r\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.898752 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.898591    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-oauth-config\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.898752 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.898622    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-serving-cert\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.898752 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.898647    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-trusted-ca-bundle\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.898752 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.898691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-config\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.898752 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.898715    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-service-ca\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.899444 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.899412    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-config\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.899444 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.899421    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-oauth-serving-cert\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.899587 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.899503    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-service-ca\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.899650 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.899633    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-trusted-ca-bundle\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.901080 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.901045    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-oauth-config\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.901205 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.901179    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-serving-cert\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:45.921266 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:45.921244    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j294r\" (UniqueName: \"kubernetes.io/projected/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-kube-api-access-j294r\") pod \"console-5697cf8ddc-hmdbb\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") " pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:46.002105 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:46.002019    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:46.136849 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:46.136817    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5697cf8ddc-hmdbb"]
Jul 15 14:34:46.140177 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:34:46.140149    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2e641c_2a24_4ebe_be28_ad9a350bbc96.slice/crio-ceda5bc81116d468df6db91aa4067cc5be0a7433eeb93f0c562c6c7c2c62fccb WatchSource:0}: Error finding container ceda5bc81116d468df6db91aa4067cc5be0a7433eeb93f0c562c6c7c2c62fccb: Status 404 returned error can't find the container with id ceda5bc81116d468df6db91aa4067cc5be0a7433eeb93f0c562c6c7c2c62fccb
Jul 15 14:34:46.709783 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:46.709750    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5697cf8ddc-hmdbb" event={"ID":"9a2e641c-2a24-4ebe-be28-ad9a350bbc96","Type":"ContainerStarted","Data":"d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7"}
Jul 15 14:34:46.710183 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:46.709800    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5697cf8ddc-hmdbb" event={"ID":"9a2e641c-2a24-4ebe-be28-ad9a350bbc96","Type":"ContainerStarted","Data":"ceda5bc81116d468df6db91aa4067cc5be0a7433eeb93f0c562c6c7c2c62fccb"}
Jul 15 14:34:46.731964 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:46.731918    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5697cf8ddc-hmdbb" podStartSLOduration=1.731903135 podStartE2EDuration="1.731903135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:34:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:46.729589978 +0000 UTC m=+246.622694344" watchObservedRunningTime="2026-07-15 14:34:46.731903135 +0000 UTC m=+246.625007587"
Jul 15 14:34:55.299584 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:55.299548    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:55.397758 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:55.397724    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:56.003028 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:56.002980    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:56.003257 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:56.003084    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:56.007843 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:56.007818    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:56.749494 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:56.749469    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:34:57.107347 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:57.107261    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:57.340438 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:34:57.340403    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:03.408052 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:35:03.407975    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:03.503166 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:35:03.503121    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:40.511197 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:35:40.511170    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 14:35:43.071123 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:35:43.071087    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:44.588453 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:35:44.588420    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:51.222906 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:51.222872    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:51.291823 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:51.291786    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:53.279079 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:53.279050    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:54.203962 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:54.203932    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:55.424660 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.424628    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79"]
Jul 15 14:37:55.427700 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.427683    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79"
Jul 15 14:37:55.431742 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.431721    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:37:55.431878 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.431749    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-crfsc\""
Jul 15 14:37:55.431878 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.431751    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 15 14:37:55.447568 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.447542    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79"]
Jul 15 14:37:55.534153 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.534104    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50b0fb26-7667-4812-a58c-4ae134eb7934-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwm79\" (UID: \"50b0fb26-7667-4812-a58c-4ae134eb7934\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79"
Jul 15 14:37:55.534321 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.534231    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzdt4\" (UniqueName: \"kubernetes.io/projected/50b0fb26-7667-4812-a58c-4ae134eb7934-kube-api-access-bzdt4\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwm79\" (UID: \"50b0fb26-7667-4812-a58c-4ae134eb7934\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79"
Jul 15 14:37:55.635471 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.635435    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdt4\" (UniqueName: \"kubernetes.io/projected/50b0fb26-7667-4812-a58c-4ae134eb7934-kube-api-access-bzdt4\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwm79\" (UID: \"50b0fb26-7667-4812-a58c-4ae134eb7934\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79"
Jul 15 14:37:55.635626 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.635502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50b0fb26-7667-4812-a58c-4ae134eb7934-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwm79\" (UID: \"50b0fb26-7667-4812-a58c-4ae134eb7934\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79"
Jul 15 14:37:55.635899 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.635869    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50b0fb26-7667-4812-a58c-4ae134eb7934-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwm79\" (UID: \"50b0fb26-7667-4812-a58c-4ae134eb7934\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79"
Jul 15 14:37:55.645255 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.645203    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzdt4\" (UniqueName: \"kubernetes.io/projected/50b0fb26-7667-4812-a58c-4ae134eb7934-kube-api-access-bzdt4\") pod \"cert-manager-operator-controller-manager-55c444bf86-cwm79\" (UID: \"50b0fb26-7667-4812-a58c-4ae134eb7934\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79"
Jul 15 14:37:55.736378 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.736298    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79"
Jul 15 14:37:55.872083 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.871949    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79"]
Jul 15 14:37:55.875117 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:37:55.875073    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b0fb26_7667_4812_a58c_4ae134eb7934.slice/crio-6261b35b79972a0fe5ccbeaf165b77e6421df4928cb4e588b99cc0c4d3298a2f WatchSource:0}: Error finding container 6261b35b79972a0fe5ccbeaf165b77e6421df4928cb4e588b99cc0c4d3298a2f: Status 404 returned error can't find the container with id 6261b35b79972a0fe5ccbeaf165b77e6421df4928cb4e588b99cc0c4d3298a2f
Jul 15 14:37:55.877675 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:55.877655    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:37:56.375833 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:56.375797    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79" event={"ID":"50b0fb26-7667-4812-a58c-4ae134eb7934","Type":"ContainerStarted","Data":"6261b35b79972a0fe5ccbeaf165b77e6421df4928cb4e588b99cc0c4d3298a2f"}
Jul 15 14:37:58.140611 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:58.140580    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:58.246333 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:58.246296    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:59.390051 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:59.390004    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79" event={"ID":"50b0fb26-7667-4812-a58c-4ae134eb7934","Type":"ContainerStarted","Data":"66690b11e5167d648a27c447d309e779856bccd4c540e740b0885a3462106e71"}
Jul 15 14:37:59.414810 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:59.414752    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cwm79" podStartSLOduration=1.076397988 podStartE2EDuration="4.41473187s" totalImagesPullingTime="3.338333882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:37:59.412865544 +0000 UTC m=+439.305969908" watchObservedRunningTime="2026-07-15 14:37:59.41473187 +0000 UTC m=+439.307836241"
Jul 15 14:37:59.797203 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:37:59.797163    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:00.620288 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:00.620252    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:00.743401 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:00.743368    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:01.338853 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.338821    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jvfxc"]
Jul 15 14:38:01.342029 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.342009    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc"
Jul 15 14:38:01.344932 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.344889    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 14:38:01.346002 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.345980    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tlktk\""
Jul 15 14:38:01.346192 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.346177    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 14:38:01.357768 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.357740    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jvfxc"]
Jul 15 14:38:01.383517 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.383488    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89b2faf0-3e48-4ae9-895e-25998026c288-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jvfxc\" (UID: \"89b2faf0-3e48-4ae9-895e-25998026c288\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc"
Jul 15 14:38:01.383517 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.383523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6clj\" (UniqueName: \"kubernetes.io/projected/89b2faf0-3e48-4ae9-895e-25998026c288-kube-api-access-w6clj\") pod \"cert-manager-webhook-6486ffd997-jvfxc\" (UID: \"89b2faf0-3e48-4ae9-895e-25998026c288\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc"
Jul 15 14:38:01.484875 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.484843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89b2faf0-3e48-4ae9-895e-25998026c288-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jvfxc\" (UID: \"89b2faf0-3e48-4ae9-895e-25998026c288\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc"
Jul 15 14:38:01.484875 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.484881    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6clj\" (UniqueName: \"kubernetes.io/projected/89b2faf0-3e48-4ae9-895e-25998026c288-kube-api-access-w6clj\") pod \"cert-manager-webhook-6486ffd997-jvfxc\" (UID: \"89b2faf0-3e48-4ae9-895e-25998026c288\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc"
Jul 15 14:38:01.500641 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.500611    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89b2faf0-3e48-4ae9-895e-25998026c288-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jvfxc\" (UID: \"89b2faf0-3e48-4ae9-895e-25998026c288\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc"
Jul 15 14:38:01.501407 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.501391    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6clj\" (UniqueName: \"kubernetes.io/projected/89b2faf0-3e48-4ae9-895e-25998026c288-kube-api-access-w6clj\") pod \"cert-manager-webhook-6486ffd997-jvfxc\" (UID: \"89b2faf0-3e48-4ae9-895e-25998026c288\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc"
Jul 15 14:38:01.650348 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.650323    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc"
Jul 15 14:38:01.800420 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:01.800396    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jvfxc"]
Jul 15 14:38:01.802076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:38:01.802041    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89b2faf0_3e48_4ae9_895e_25998026c288.slice/crio-3163d7321d533350260fa5e212b3077505b1cd49bac822bb8e2edeaec0565a1b WatchSource:0}: Error finding container 3163d7321d533350260fa5e212b3077505b1cd49bac822bb8e2edeaec0565a1b: Status 404 returned error can't find the container with id 3163d7321d533350260fa5e212b3077505b1cd49bac822bb8e2edeaec0565a1b
Jul 15 14:38:02.404035 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:02.403973    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc" event={"ID":"89b2faf0-3e48-4ae9-895e-25998026c288","Type":"ContainerStarted","Data":"3163d7321d533350260fa5e212b3077505b1cd49bac822bb8e2edeaec0565a1b"}
Jul 15 14:38:02.447084 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:02.447048    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:02.846578 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:02.846492    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:03.886648 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:03.886612    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:04.193831 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:04.193794    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:04.412625 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:04.412588    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc" event={"ID":"89b2faf0-3e48-4ae9-895e-25998026c288","Type":"ContainerStarted","Data":"a5793ae115ca001929f0f27a975e5db2980bd08ddeaf940c2a9732a6d0d17ced"}
Jul 15 14:38:04.412785 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:04.412725    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc"
Jul 15 14:38:04.442930 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:04.442884    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc" podStartSLOduration=0.960539625 podStartE2EDuration="3.442869054s" totalImagesPullingTime="2.482329429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:38:04.441990224 +0000 UTC m=+444.335094589" watchObservedRunningTime="2026-07-15 14:38:04.442869054 +0000 UTC m=+444.335973419"
Jul 15 14:38:10.417648 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:10.417615    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jvfxc"
Jul 15 14:38:10.429207 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:10.429171    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:11.256990 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:11.256958    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:11.354045 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:11.354010    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:12.206320 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.206284    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5"]
Jul 15 14:38:12.209489 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.209469    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5"
Jul 15 14:38:12.216847 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.216831    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 14:38:12.218065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.218050    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:38:12.218114 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.218088    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-k64jd\""
Jul 15 14:38:12.276063 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.276030    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7r8d\" (UniqueName: \"kubernetes.io/projected/aafc4239-3b25-4da8-989a-3b8c1afd3012-kube-api-access-r7r8d\") pod \"openshift-lws-operator-fd8ccff4c-q62n5\" (UID: \"aafc4239-3b25-4da8-989a-3b8c1afd3012\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5"
Jul 15 14:38:12.276063 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.276063    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aafc4239-3b25-4da8-989a-3b8c1afd3012-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q62n5\" (UID: \"aafc4239-3b25-4da8-989a-3b8c1afd3012\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5"
Jul 15 14:38:12.290338 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.290316    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5"]
Jul 15 14:38:12.376961 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.376931    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7r8d\" (UniqueName: \"kubernetes.io/projected/aafc4239-3b25-4da8-989a-3b8c1afd3012-kube-api-access-r7r8d\") pod \"openshift-lws-operator-fd8ccff4c-q62n5\" (UID: \"aafc4239-3b25-4da8-989a-3b8c1afd3012\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5"
Jul 15 14:38:12.376961 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.376964    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aafc4239-3b25-4da8-989a-3b8c1afd3012-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q62n5\" (UID: \"aafc4239-3b25-4da8-989a-3b8c1afd3012\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5"
Jul 15 14:38:12.377346 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.377327    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aafc4239-3b25-4da8-989a-3b8c1afd3012-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q62n5\" (UID: \"aafc4239-3b25-4da8-989a-3b8c1afd3012\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5"
Jul 15 14:38:12.386533 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.386510    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7r8d\" (UniqueName: \"kubernetes.io/projected/aafc4239-3b25-4da8-989a-3b8c1afd3012-kube-api-access-r7r8d\") pod \"openshift-lws-operator-fd8ccff4c-q62n5\" (UID: \"aafc4239-3b25-4da8-989a-3b8c1afd3012\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5"
Jul 15 14:38:12.518048 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.517960    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5"
Jul 15 14:38:12.646238 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:12.646210    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5"]
Jul 15 14:38:12.648176 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:38:12.648147    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaafc4239_3b25_4da8_989a_3b8c1afd3012.slice/crio-c31ed6d1023b4d02a91a567ad62b09c7c8dc0afb31129da39ad22f1fca39539e WatchSource:0}: Error finding container c31ed6d1023b4d02a91a567ad62b09c7c8dc0afb31129da39ad22f1fca39539e: Status 404 returned error can't find the container with id c31ed6d1023b4d02a91a567ad62b09c7c8dc0afb31129da39ad22f1fca39539e
Jul 15 14:38:13.447247 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:13.447211    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5" event={"ID":"aafc4239-3b25-4da8-989a-3b8c1afd3012","Type":"ContainerStarted","Data":"c31ed6d1023b4d02a91a567ad62b09c7c8dc0afb31129da39ad22f1fca39539e"}
Jul 15 14:38:16.461550 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:16.461513    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5" event={"ID":"aafc4239-3b25-4da8-989a-3b8c1afd3012","Type":"ContainerStarted","Data":"5b76873f81ffef2d4ceed820c6ee15ee0ea094fa177d6bbd376d97c7cbc2eebe"}
Jul 15 14:38:16.486065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:16.486008    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q62n5" podStartSLOduration=1.616337135 podStartE2EDuration="4.485992452s" totalImagesPullingTime="2.869655317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:38:16.483984302 +0000 UTC m=+456.377088666" watchObservedRunningTime="2026-07-15 14:38:16.485992452 +0000 UTC m=+456.379096818"
Jul 15 14:38:17.302169 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:17.302110    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:17.408331 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:17.408298    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:19.076265 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:19.076236    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:33.729435 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:33.729402    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:33.829326 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:33.829294    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:34.460020 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:34.459990    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:34.853636 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:34.853564    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:34.954399 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:34.954361    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:35.098714 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.098683    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"]
Jul 15 14:38:35.111594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.111546    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.115649 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.115108    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 14:38:35.115649 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.115191    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 14:38:35.115649 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.115400    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 14:38:35.115649 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.115507    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kcdzw\""
Jul 15 14:38:35.117484 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.116034    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 14:38:35.137362 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.137336    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"]
Jul 15 14:38:35.168427 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.168392    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9aec7704-c886-45ea-b7d9-ad56da099b7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.168579 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.168443    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq69c\" (UniqueName: \"kubernetes.io/projected/9aec7704-c886-45ea-b7d9-ad56da099b7f-kube-api-access-rq69c\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.168579 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.168507    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9aec7704-c886-45ea-b7d9-ad56da099b7f-manifests\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.168579 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.168535    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9aec7704-c886-45ea-b7d9-ad56da099b7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.168579 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.168568    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9aec7704-c886-45ea-b7d9-ad56da099b7f-tmp\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.269152 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.269106    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq69c\" (UniqueName: \"kubernetes.io/projected/9aec7704-c886-45ea-b7d9-ad56da099b7f-kube-api-access-rq69c\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.269330 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.269169    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9aec7704-c886-45ea-b7d9-ad56da099b7f-manifests\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.269330 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.269212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9aec7704-c886-45ea-b7d9-ad56da099b7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.269330 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.269244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9aec7704-c886-45ea-b7d9-ad56da099b7f-tmp\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.269330 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.269293    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9aec7704-c886-45ea-b7d9-ad56da099b7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.269546 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.269526    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9aec7704-c886-45ea-b7d9-ad56da099b7f-manifests\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.271477 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.271449    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9aec7704-c886-45ea-b7d9-ad56da099b7f-tmp\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.271669 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.271652    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9aec7704-c886-45ea-b7d9-ad56da099b7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.271797 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.271777    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9aec7704-c886-45ea-b7d9-ad56da099b7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.280472 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.280447    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq69c\" (UniqueName: \"kubernetes.io/projected/9aec7704-c886-45ea-b7d9-ad56da099b7f-kube-api-access-rq69c\") pod \"opendatahub-operator-controller-manager-846b6d9d56-g4wcv\" (UID: \"9aec7704-c886-45ea-b7d9-ad56da099b7f\") " pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.371060 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.370980    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:35.425565 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.425535    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:35.472119 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.472087    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:35.575991 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.575959    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:35.590524 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.590385    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"]
Jul 15 14:38:35.593467 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:38:35.593442    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aec7704_c886_45ea_b7d9_ad56da099b7f.slice/crio-9c9056bfee28ef9adc830223c0106c8e5a8df39edf333cb71f4d8dfe298cae31 WatchSource:0}: Error finding container 9c9056bfee28ef9adc830223c0106c8e5a8df39edf333cb71f4d8dfe298cae31: Status 404 returned error can't find the container with id 9c9056bfee28ef9adc830223c0106c8e5a8df39edf333cb71f4d8dfe298cae31
Jul 15 14:38:35.678961 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.678930    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:35.782838 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:35.782791    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:36.544683 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:36.544643    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv" event={"ID":"9aec7704-c886-45ea-b7d9-ad56da099b7f","Type":"ContainerStarted","Data":"9c9056bfee28ef9adc830223c0106c8e5a8df39edf333cb71f4d8dfe298cae31"}
Jul 15 14:38:39.558724 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:39.558692    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv" event={"ID":"9aec7704-c886-45ea-b7d9-ad56da099b7f","Type":"ContainerStarted","Data":"63d9edede5a151d06511bd204961f992dd2a89a4ba9aad335109d0024efc5ffa"}
Jul 15 14:38:40.333737 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:40.333708    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:40.412046 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:40.412015    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:40.563174 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:40.563126    2574 generic.go:356] "Generic (PLEG): container finished" podID="9aec7704-c886-45ea-b7d9-ad56da099b7f" containerID="63d9edede5a151d06511bd204961f992dd2a89a4ba9aad335109d0024efc5ffa" exitCode=0
Jul 15 14:38:40.563612 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:40.563189    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv" event={"ID":"9aec7704-c886-45ea-b7d9-ad56da099b7f","Type":"ContainerDied","Data":"63d9edede5a151d06511bd204961f992dd2a89a4ba9aad335109d0024efc5ffa"}
Jul 15 14:38:41.571458 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:41.571421    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv" event={"ID":"9aec7704-c886-45ea-b7d9-ad56da099b7f","Type":"ContainerStarted","Data":"d9dd6fb6a13edf13c3e06e0e34b9ebeb613e8862b39ddadaab036f3c50fdc9c9"}
Jul 15 14:38:41.571939 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:41.571563    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:41.603218 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:41.603173    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv" podStartSLOduration=1.700864945 podStartE2EDuration="6.603158461s" totalImagesPullingTime="3.81731755s" totalInitContainerRuntime="1.084975966s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:38:41.601875439 +0000 UTC m=+481.494979818" watchObservedRunningTime="2026-07-15 14:38:41.603158461 +0000 UTC m=+481.496262822"
Jul 15 14:38:47.667343 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:47.667307    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:47.776700 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:47.776659    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:51.624126 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:51.620992    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5697cf8ddc-hmdbb"]
Jul 15 14:38:52.513277 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:52.513211    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:52.577356 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:52.577331    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-846b6d9d56-g4wcv"
Jul 15 14:38:52.619388 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:52.619353    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:57.472915 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.472884    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"]
Jul 15 14:38:57.481289 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.481267    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:57.490374 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:57.490347    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret"
Jul 15 14:38:57.490830 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:57.490803    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-86c7c45d84-qxhpz\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="17469757-54d1-4005-b0a1-b0c9eed09c27" pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:57.490830 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:57.490811    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret"
Jul 15 14:38:57.490958 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:57.490916    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 15 14:38:57.491046 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:57.491025    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 15 14:38:57.529436 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.529406    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"]
Jul 15 14:38:57.546656 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.546625    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17469757-54d1-4005-b0a1-b0c9eed09c27-tmp\") pod \"kube-auth-proxy-86c7c45d84-qxhpz\" (UID: \"17469757-54d1-4005-b0a1-b0c9eed09c27\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:57.546786 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.546670    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17469757-54d1-4005-b0a1-b0c9eed09c27-tls-certs\") pod \"kube-auth-proxy-86c7c45d84-qxhpz\" (UID: \"17469757-54d1-4005-b0a1-b0c9eed09c27\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:57.546786 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.546703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5vp6\" (UniqueName: \"kubernetes.io/projected/17469757-54d1-4005-b0a1-b0c9eed09c27-kube-api-access-q5vp6\") pod \"kube-auth-proxy-86c7c45d84-qxhpz\" (UID: \"17469757-54d1-4005-b0a1-b0c9eed09c27\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:57.647367 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.647325    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17469757-54d1-4005-b0a1-b0c9eed09c27-tmp\") pod \"kube-auth-proxy-86c7c45d84-qxhpz\" (UID: \"17469757-54d1-4005-b0a1-b0c9eed09c27\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:57.647545 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.647389    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17469757-54d1-4005-b0a1-b0c9eed09c27-tls-certs\") pod \"kube-auth-proxy-86c7c45d84-qxhpz\" (UID: \"17469757-54d1-4005-b0a1-b0c9eed09c27\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:57.647545 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.647414    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5vp6\" (UniqueName: \"kubernetes.io/projected/17469757-54d1-4005-b0a1-b0c9eed09c27-kube-api-access-q5vp6\") pod \"kube-auth-proxy-86c7c45d84-qxhpz\" (UID: \"17469757-54d1-4005-b0a1-b0c9eed09c27\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:57.649713 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.649678    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17469757-54d1-4005-b0a1-b0c9eed09c27-tmp\") pod \"kube-auth-proxy-86c7c45d84-qxhpz\" (UID: \"17469757-54d1-4005-b0a1-b0c9eed09c27\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:57.808737 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.808657    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:57.868000 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.863392    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lsmqk"]
Jul 15 14:38:57.869835 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.869805    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk"
Jul 15 14:38:57.880125 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.880100    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5rk7c\""
Jul 15 14:38:57.882382 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.882364    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 15 14:38:57.932255 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.932225    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lsmqk"]
Jul 15 14:38:57.950756 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.950724    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbngl\" (UniqueName: \"kubernetes.io/projected/fe634588-29b9-4afe-a83d-33ed0982c29f-kube-api-access-zbngl\") pod \"odh-model-controller-7998c67dc4-lsmqk\" (UID: \"fe634588-29b9-4afe-a83d-33ed0982c29f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk"
Jul 15 14:38:57.950922 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:57.950779    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe634588-29b9-4afe-a83d-33ed0982c29f-cert\") pod \"odh-model-controller-7998c67dc4-lsmqk\" (UID: \"fe634588-29b9-4afe-a83d-33ed0982c29f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk"
Jul 15 14:38:58.008477 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.008442    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:58.051480 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.051448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbngl\" (UniqueName: \"kubernetes.io/projected/fe634588-29b9-4afe-a83d-33ed0982c29f-kube-api-access-zbngl\") pod \"odh-model-controller-7998c67dc4-lsmqk\" (UID: \"fe634588-29b9-4afe-a83d-33ed0982c29f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk"
Jul 15 14:38:58.051661 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.051495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe634588-29b9-4afe-a83d-33ed0982c29f-cert\") pod \"odh-model-controller-7998c67dc4-lsmqk\" (UID: \"fe634588-29b9-4afe-a83d-33ed0982c29f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk"
Jul 15 14:38:58.051661 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:58.051623    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 15 14:38:58.051792 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:58.051688    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe634588-29b9-4afe-a83d-33ed0982c29f-cert podName:fe634588-29b9-4afe-a83d-33ed0982c29f nodeName:}" failed. No retries permitted until 2026-07-15 14:38:58.551668337 +0000 UTC m=+498.444772683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fe634588-29b9-4afe-a83d-33ed0982c29f-cert") pod "odh-model-controller-7998c67dc4-lsmqk" (UID: "fe634588-29b9-4afe-a83d-33ed0982c29f") : secret "odh-model-controller-webhook-cert" not found
Jul 15 14:38:58.077456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.077388    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbngl\" (UniqueName: \"kubernetes.io/projected/fe634588-29b9-4afe-a83d-33ed0982c29f-kube-api-access-zbngl\") pod \"odh-model-controller-7998c67dc4-lsmqk\" (UID: \"fe634588-29b9-4afe-a83d-33ed0982c29f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk"
Jul 15 14:38:58.289215 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.289173    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:58.423988 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.423960    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 14:38:58.544529 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.544494    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:58.555870 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.555841    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe634588-29b9-4afe-a83d-33ed0982c29f-cert\") pod \"odh-model-controller-7998c67dc4-lsmqk\" (UID: \"fe634588-29b9-4afe-a83d-33ed0982c29f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk"
Jul 15 14:38:58.558298 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.558268    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe634588-29b9-4afe-a83d-33ed0982c29f-cert\") pod \"odh-model-controller-7998c67dc4-lsmqk\" (UID: \"fe634588-29b9-4afe-a83d-33ed0982c29f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk"
Jul 15 14:38:58.647954 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:58.647921    2574 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: failed to sync secret cache: timed out waiting for the condition
Jul 15 14:38:58.648122 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:58.648009    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17469757-54d1-4005-b0a1-b0c9eed09c27-tls-certs podName:17469757-54d1-4005-b0a1-b0c9eed09c27 nodeName:}" failed. No retries permitted until 2026-07-15 14:38:59.147986789 +0000 UTC m=+499.041091140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/17469757-54d1-4005-b0a1-b0c9eed09c27-tls-certs") pod "kube-auth-proxy-86c7c45d84-qxhpz" (UID: "17469757-54d1-4005-b0a1-b0c9eed09c27") : failed to sync secret cache: timed out waiting for the condition
Jul 15 14:38:58.684611 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:58.684528    2574 projected.go:291] Couldn't get configMap openshift-ingress/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 15 14:38:58.744792 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.744756    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 14:38:58.754995 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:58.754963    2574 projected.go:196] Error preparing data for projected volume kube-api-access-q5vp6 for pod openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz: failed to sync configmap cache: timed out waiting for the condition
Jul 15 14:38:58.755156 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:38:58.755046    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17469757-54d1-4005-b0a1-b0c9eed09c27-kube-api-access-q5vp6 podName:17469757-54d1-4005-b0a1-b0c9eed09c27 nodeName:}" failed. No retries permitted until 2026-07-15 14:38:59.255024761 +0000 UTC m=+499.148129104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q5vp6" (UniqueName: "kubernetes.io/projected/17469757-54d1-4005-b0a1-b0c9eed09c27-kube-api-access-q5vp6") pod "kube-auth-proxy-86c7c45d84-qxhpz" (UID: "17469757-54d1-4005-b0a1-b0c9eed09c27") : failed to sync configmap cache: timed out waiting for the condition
Jul 15 14:38:58.782089 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.782047    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk"
Jul 15 14:38:58.908387 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.908361    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 14:38:58.978433 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:58.978350    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lsmqk"]
Jul 15 14:38:58.981390 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:38:58.981364    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe634588_29b9_4afe_a83d_33ed0982c29f.slice/crio-b349fc6da5fe1c49932508e1326bc5a467ee8d370b5a31552ee1cd5334bdc927 WatchSource:0}: Error finding container b349fc6da5fe1c49932508e1326bc5a467ee8d370b5a31552ee1cd5334bdc927: Status 404 returned error can't find the container with id b349fc6da5fe1c49932508e1326bc5a467ee8d370b5a31552ee1cd5334bdc927
Jul 15 14:38:59.087539 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:59.087505    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 14:38:59.161520 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:59.161485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17469757-54d1-4005-b0a1-b0c9eed09c27-tls-certs\") pod \"kube-auth-proxy-86c7c45d84-qxhpz\" (UID: \"17469757-54d1-4005-b0a1-b0c9eed09c27\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:59.163974 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:59.163938    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17469757-54d1-4005-b0a1-b0c9eed09c27-tls-certs\") pod \"kube-auth-proxy-86c7c45d84-qxhpz\" (UID: \"17469757-54d1-4005-b0a1-b0c9eed09c27\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:59.263103 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:59.263015    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5vp6\" (UniqueName: \"kubernetes.io/projected/17469757-54d1-4005-b0a1-b0c9eed09c27-kube-api-access-q5vp6\") pod \"kube-auth-proxy-86c7c45d84-qxhpz\" (UID: \"17469757-54d1-4005-b0a1-b0c9eed09c27\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:59.265573 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:59.265547    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5vp6\" (UniqueName: \"kubernetes.io/projected/17469757-54d1-4005-b0a1-b0c9eed09c27-kube-api-access-q5vp6\") pod \"kube-auth-proxy-86c7c45d84-qxhpz\" (UID: \"17469757-54d1-4005-b0a1-b0c9eed09c27\") " pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:59.289973 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:59.289948    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"
Jul 15 14:38:59.482008 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:59.481978    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz"]
Jul 15 14:38:59.482468 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:38:59.482446    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17469757_54d1_4005_b0a1_b0c9eed09c27.slice/crio-691bae2eb3ba11b0e999f61319ed1f2aed0deb10a5213c2106875be04acd2afd WatchSource:0}: Error finding container 691bae2eb3ba11b0e999f61319ed1f2aed0deb10a5213c2106875be04acd2afd: Status 404 returned error can't find the container with id 691bae2eb3ba11b0e999f61319ed1f2aed0deb10a5213c2106875be04acd2afd
Jul 15 14:38:59.652237 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:59.652200    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz" event={"ID":"17469757-54d1-4005-b0a1-b0c9eed09c27","Type":"ContainerStarted","Data":"691bae2eb3ba11b0e999f61319ed1f2aed0deb10a5213c2106875be04acd2afd"}
Jul 15 14:38:59.653982 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:38:59.653950    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk" event={"ID":"fe634588-29b9-4afe-a83d-33ed0982c29f","Type":"ContainerStarted","Data":"b349fc6da5fe1c49932508e1326bc5a467ee8d370b5a31552ee1cd5334bdc927"}
Jul 15 14:39:00.048660 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.048548    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:00.210400 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.210352    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-78lwg"]
Jul 15 14:39:00.213912 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.213886    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-78lwg"
Jul 15 14:39:00.217579 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.217553    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 14:39:00.273418 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.273381    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnmjl\" (UniqueName: \"kubernetes.io/projected/e75bb13e-4efb-4351-b86e-c6352787b709-kube-api-access-vnmjl\") pod \"model-serving-api-54d89bd5fc-78lwg\" (UID: \"e75bb13e-4efb-4351-b86e-c6352787b709\") " pod="opendatahub/model-serving-api-54d89bd5fc-78lwg"
Jul 15 14:39:00.273609 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.273486    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e75bb13e-4efb-4351-b86e-c6352787b709-tls-certs\") pod \"model-serving-api-54d89bd5fc-78lwg\" (UID: \"e75bb13e-4efb-4351-b86e-c6352787b709\") " pod="opendatahub/model-serving-api-54d89bd5fc-78lwg"
Jul 15 14:39:00.344332 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.344226    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:00.358998 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.356108    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-78lwg"]
Jul 15 14:39:00.374825 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.374763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e75bb13e-4efb-4351-b86e-c6352787b709-tls-certs\") pod \"model-serving-api-54d89bd5fc-78lwg\" (UID: \"e75bb13e-4efb-4351-b86e-c6352787b709\") " pod="opendatahub/model-serving-api-54d89bd5fc-78lwg"
Jul 15 14:39:00.375019 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.374875    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnmjl\" (UniqueName: \"kubernetes.io/projected/e75bb13e-4efb-4351-b86e-c6352787b709-kube-api-access-vnmjl\") pod \"model-serving-api-54d89bd5fc-78lwg\" (UID: \"e75bb13e-4efb-4351-b86e-c6352787b709\") " pod="opendatahub/model-serving-api-54d89bd5fc-78lwg"
Jul 15 14:39:00.378050 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.378021    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e75bb13e-4efb-4351-b86e-c6352787b709-tls-certs\") pod \"model-serving-api-54d89bd5fc-78lwg\" (UID: \"e75bb13e-4efb-4351-b86e-c6352787b709\") " pod="opendatahub/model-serving-api-54d89bd5fc-78lwg"
Jul 15 14:39:00.401472 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.401444    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnmjl\" (UniqueName: \"kubernetes.io/projected/e75bb13e-4efb-4351-b86e-c6352787b709-kube-api-access-vnmjl\") pod \"model-serving-api-54d89bd5fc-78lwg\" (UID: \"e75bb13e-4efb-4351-b86e-c6352787b709\") " pod="opendatahub/model-serving-api-54d89bd5fc-78lwg"
Jul 15 14:39:00.529194 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:00.529059    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-78lwg"
Jul 15 14:39:02.103490 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.103454    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"]
Jul 15 14:39:02.104388 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.104362    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:02.107436 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.107414    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.112277 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.112246    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 14:39:02.112696 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.112641    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 14:39:02.112814 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.112650    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 14:39:02.113385 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.113363    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 14:39:02.113495 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.113364    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g9z86\""
Jul 15 14:39:02.130028 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.130002    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"]
Jul 15 14:39:02.189786 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.189741    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rgzd\" (UniqueName: \"kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-kube-api-access-7rgzd\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.189968 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.189798    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.189968 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.189894    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-istio-token\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.190086 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.189989    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/282cbf33-6403-467c-a2c3-f121124bf51e-local-certs\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.190086 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.190016    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-cacerts\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.190086 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.190055    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.190247 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.190114    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.243441 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.243354    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:02.291447 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.291412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/282cbf33-6403-467c-a2c3-f121124bf51e-local-certs\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.291447 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.291457    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-cacerts\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.291705 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.291491    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.291705 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.291516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.291705 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.291597    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rgzd\" (UniqueName: \"kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-kube-api-access-7rgzd\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.291705 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.291654    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.291705 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.291694    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-istio-token\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.292254 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.292229    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.294065 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.294033    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/282cbf33-6403-467c-a2c3-f121124bf51e-local-certs\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.294459 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.294278    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.294459 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.294384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-cacerts\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.294624 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.294542    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.304503 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.304451    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rgzd\" (UniqueName: \"kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-kube-api-access-7rgzd\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.304761 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.304741    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-istio-token\") pod \"istiod-openshift-gateway-7574459656-9tz25\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.419458 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.419427    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:02.680726 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.680195    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk" event={"ID":"fe634588-29b9-4afe-a83d-33ed0982c29f","Type":"ContainerStarted","Data":"2e3a6aa67187b656adccf2622f0f52c27527c65dc708108b107442bc4ae2ed77"}
Jul 15 14:39:02.680855 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.680727    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk"
Jul 15 14:39:02.683797 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.683756    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz" event={"ID":"17469757-54d1-4005-b0a1-b0c9eed09c27","Type":"ContainerStarted","Data":"cc210d89bd940addc993640aad422c455b5d43404ebb0f0f30508f6be1f1ceaf"}
Jul 15 14:39:02.711527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.709969    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk" podStartSLOduration=2.118365414 podStartE2EDuration="5.709946385s" totalImagesPullingTime="3.591580971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:02.707018834 +0000 UTC m=+502.600123201" watchObservedRunningTime="2026-07-15 14:39:02.709946385 +0000 UTC m=+502.603050751"
Jul 15 14:39:02.748218 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.748157    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-86c7c45d84-qxhpz" podStartSLOduration=2.649973801 podStartE2EDuration="5.748124517s" totalImagesPullingTime="3.098150716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:38:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:02.746356324 +0000 UTC m=+502.639460690" watchObservedRunningTime="2026-07-15 14:39:02.748124517 +0000 UTC m=+502.641228881"
Jul 15 14:39:02.803894 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.803864    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"]
Jul 15 14:39:02.805039 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:39:02.805014    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282cbf33_6403_467c_a2c3_f121124bf51e.slice/crio-ac1c62b8a53aa68dfb3f51dc4bc0acc3d4f60bcf0752d2666b3caf128c216365 WatchSource:0}: Error finding container ac1c62b8a53aa68dfb3f51dc4bc0acc3d4f60bcf0752d2666b3caf128c216365: Status 404 returned error can't find the container with id ac1c62b8a53aa68dfb3f51dc4bc0acc3d4f60bcf0752d2666b3caf128c216365
Jul 15 14:39:02.805562 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:39:02.805543    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75bb13e_4efb_4351_b86e_c6352787b709.slice/crio-69e5f5114b32e3f2e55c17c7bc7365ab876b8b39c601d4e0da8408d3600e2702 WatchSource:0}: Error finding container 69e5f5114b32e3f2e55c17c7bc7365ab876b8b39c601d4e0da8408d3600e2702: Status 404 returned error can't find the container with id 69e5f5114b32e3f2e55c17c7bc7365ab876b8b39c601d4e0da8408d3600e2702
Jul 15 14:39:02.806037 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:02.806013    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-78lwg"]
Jul 15 14:39:03.690244 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:03.690207    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25" event={"ID":"282cbf33-6403-467c-a2c3-f121124bf51e","Type":"ContainerStarted","Data":"ac1c62b8a53aa68dfb3f51dc4bc0acc3d4f60bcf0752d2666b3caf128c216365"}
Jul 15 14:39:03.691483 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:03.691454    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-78lwg" event={"ID":"e75bb13e-4efb-4351-b86e-c6352787b709","Type":"ContainerStarted","Data":"69e5f5114b32e3f2e55c17c7bc7365ab876b8b39c601d4e0da8408d3600e2702"}
Jul 15 14:39:04.063707 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:04.063569    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:05.838662 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:05.838627    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 14:39:05.839016 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:05.838712    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 14:39:06.709224 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:06.709178    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-78lwg" event={"ID":"e75bb13e-4efb-4351-b86e-c6352787b709","Type":"ContainerStarted","Data":"30929bd431feacd6d0165a936942b99626b43a5af53a18e7f7e7d34eac614d9a"}
Jul 15 14:39:06.709451 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:06.709314    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-78lwg"
Jul 15 14:39:06.710819 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:06.710796    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25" event={"ID":"282cbf33-6403-467c-a2c3-f121124bf51e","Type":"ContainerStarted","Data":"67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144"}
Jul 15 14:39:06.711008 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:06.710990    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:06.712419 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:06.712387    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9tz25 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 14:39:06.712538 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:06.712447    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25" podUID="282cbf33-6403-467c-a2c3-f121124bf51e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 14:39:06.763561 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:06.763506    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-78lwg" podStartSLOduration=3.738442116 podStartE2EDuration="6.763489573s" totalImagesPullingTime="3.025047457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:06.761803265 +0000 UTC m=+506.654907631" watchObservedRunningTime="2026-07-15 14:39:06.763489573 +0000 UTC m=+506.656593937"
Jul 15 14:39:06.942831 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:06.942794    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:07.085658 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:07.085579    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:07.715798 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:07.715765    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9tz25 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 14:39:07.715961 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:07.715826    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25" podUID="282cbf33-6403-467c-a2c3-f121124bf51e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 14:39:08.432438 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:08.432405    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:08.733008 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:08.732920    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:08.890924 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:08.890891    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:10.716032 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:10.716005    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:10.804655 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:10.804604    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25" podStartSLOduration=5.773810805 podStartE2EDuration="8.804567273s" totalImagesPullingTime="3.030756468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:39:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:06.808574374 +0000 UTC m=+506.701678740" watchObservedRunningTime="2026-07-15 14:39:10.804567273 +0000 UTC m=+510.697671639"
Jul 15 14:39:12.701490 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:12.701462    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:12.925525 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:12.925490    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"]
Jul 15 14:39:12.932306 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:12.932281    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"
Jul 15 14:39:12.935028 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:12.935003    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"]
Jul 15 14:39:12.937596 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:12.937579    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"
Jul 15 14:39:12.938586 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:12.938566    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 14:39:12.938690 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:12.938636    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-psf9b\""
Jul 15 14:39:12.948616 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:12.948504    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 15 14:39:12.948985 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:12.948959    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-k4htk\""
Jul 15 14:39:12.966607 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:12.966541    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"]
Jul 15 14:39:12.983469 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:12.983436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:13.076048 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.076014    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"]
Jul 15 14:39:13.088102 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.088073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks2dm\" (UniqueName: \"kubernetes.io/projected/8b1d83ae-11b0-4164-886c-0f11faab6c7b-kube-api-access-ks2dm\") pod \"kserve-controller-manager-d6f4b65b8-jwscq\" (UID: \"8b1d83ae-11b0-4164-886c-0f11faab6c7b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"
Jul 15 14:39:13.088264 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.088125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00200266-83dc-421a-8a60-52c89a10f6ea-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l92vm\" (UID: \"00200266-83dc-421a-8a60-52c89a10f6ea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"
Jul 15 14:39:13.088264 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.088213    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b1d83ae-11b0-4164-886c-0f11faab6c7b-cert\") pod \"kserve-controller-manager-d6f4b65b8-jwscq\" (UID: \"8b1d83ae-11b0-4164-886c-0f11faab6c7b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"
Jul 15 14:39:13.088264 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.088242    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvb2l\" (UniqueName: \"kubernetes.io/projected/00200266-83dc-421a-8a60-52c89a10f6ea-kube-api-access-pvb2l\") pod \"llmisvc-controller-manager-777c6bd7d5-l92vm\" (UID: \"00200266-83dc-421a-8a60-52c89a10f6ea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"
Jul 15 14:39:13.167478 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.167447    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:13.189422 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.189394    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00200266-83dc-421a-8a60-52c89a10f6ea-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l92vm\" (UID: \"00200266-83dc-421a-8a60-52c89a10f6ea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"
Jul 15 14:39:13.189594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.189451    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b1d83ae-11b0-4164-886c-0f11faab6c7b-cert\") pod \"kserve-controller-manager-d6f4b65b8-jwscq\" (UID: \"8b1d83ae-11b0-4164-886c-0f11faab6c7b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"
Jul 15 14:39:13.189594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.189480    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvb2l\" (UniqueName: \"kubernetes.io/projected/00200266-83dc-421a-8a60-52c89a10f6ea-kube-api-access-pvb2l\") pod \"llmisvc-controller-manager-777c6bd7d5-l92vm\" (UID: \"00200266-83dc-421a-8a60-52c89a10f6ea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"
Jul 15 14:39:13.189594 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:39:13.189576    2574 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 15 14:39:13.189741 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:39:13.189656    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00200266-83dc-421a-8a60-52c89a10f6ea-cert podName:00200266-83dc-421a-8a60-52c89a10f6ea nodeName:}" failed. No retries permitted until 2026-07-15 14:39:13.68963239 +0000 UTC m=+513.582736735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/00200266-83dc-421a-8a60-52c89a10f6ea-cert") pod "llmisvc-controller-manager-777c6bd7d5-l92vm" (UID: "00200266-83dc-421a-8a60-52c89a10f6ea") : secret "llmisvc-webhook-server-cert" not found
Jul 15 14:39:13.189741 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.189678    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks2dm\" (UniqueName: \"kubernetes.io/projected/8b1d83ae-11b0-4164-886c-0f11faab6c7b-kube-api-access-ks2dm\") pod \"kserve-controller-manager-d6f4b65b8-jwscq\" (UID: \"8b1d83ae-11b0-4164-886c-0f11faab6c7b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"
Jul 15 14:39:13.191982 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.191961    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b1d83ae-11b0-4164-886c-0f11faab6c7b-cert\") pod \"kserve-controller-manager-d6f4b65b8-jwscq\" (UID: \"8b1d83ae-11b0-4164-886c-0f11faab6c7b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"
Jul 15 14:39:13.210726 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.210699    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvb2l\" (UniqueName: \"kubernetes.io/projected/00200266-83dc-421a-8a60-52c89a10f6ea-kube-api-access-pvb2l\") pod \"llmisvc-controller-manager-777c6bd7d5-l92vm\" (UID: \"00200266-83dc-421a-8a60-52c89a10f6ea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"
Jul 15 14:39:13.212779 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.212760    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks2dm\" (UniqueName: \"kubernetes.io/projected/8b1d83ae-11b0-4164-886c-0f11faab6c7b-kube-api-access-ks2dm\") pod \"kserve-controller-manager-d6f4b65b8-jwscq\" (UID: \"8b1d83ae-11b0-4164-886c-0f11faab6c7b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"
Jul 15 14:39:13.245637 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.245571    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"
Jul 15 14:39:13.289327 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.289027    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:13.401331 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.401156    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"]
Jul 15 14:39:13.403940 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:39:13.403913    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1d83ae_11b0_4164_886c_0f11faab6c7b.slice/crio-124023e8fc918c7c77978ad7f7778e4ec7bb8b514ca4ad8c78db539993bf673c WatchSource:0}: Error finding container 124023e8fc918c7c77978ad7f7778e4ec7bb8b514ca4ad8c78db539993bf673c: Status 404 returned error can't find the container with id 124023e8fc918c7c77978ad7f7778e4ec7bb8b514ca4ad8c78db539993bf673c
Jul 15 14:39:13.510474 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.510401    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:13.694032 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.693999    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lsmqk"
Jul 15 14:39:13.694277 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.694256    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00200266-83dc-421a-8a60-52c89a10f6ea-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l92vm\" (UID: \"00200266-83dc-421a-8a60-52c89a10f6ea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"
Jul 15 14:39:13.696576 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.696555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00200266-83dc-421a-8a60-52c89a10f6ea-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l92vm\" (UID: \"00200266-83dc-421a-8a60-52c89a10f6ea\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"
Jul 15 14:39:13.742667 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.742638    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq" event={"ID":"8b1d83ae-11b0-4164-886c-0f11faab6c7b","Type":"ContainerStarted","Data":"124023e8fc918c7c77978ad7f7778e4ec7bb8b514ca4ad8c78db539993bf673c"}
Jul 15 14:39:13.852520 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:13.852419    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"
Jul 15 14:39:14.081926 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:14.081903    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"]
Jul 15 14:39:14.084372 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:39:14.084346    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod00200266_83dc_421a_8a60_52c89a10f6ea.slice/crio-f99adf946bd45cca3543a13a806d1139724964b21e032fb57cedfadb7279dca4 WatchSource:0}: Error finding container f99adf946bd45cca3543a13a806d1139724964b21e032fb57cedfadb7279dca4: Status 404 returned error can't find the container with id f99adf946bd45cca3543a13a806d1139724964b21e032fb57cedfadb7279dca4
Jul 15 14:39:14.223686 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:14.223651    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:14.355594 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:14.355553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:14.568605 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:14.568520    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:14.748949 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:14.748882    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm" event={"ID":"00200266-83dc-421a-8a60-52c89a10f6ea","Type":"ContainerStarted","Data":"f99adf946bd45cca3543a13a806d1139724964b21e032fb57cedfadb7279dca4"}
Jul 15 14:39:16.648489 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:16.648401    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5697cf8ddc-hmdbb" podUID="9a2e641c-2a24-4ebe-be28-ad9a350bbc96" containerName="console" containerID="cri-o://d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7" gracePeriod=15
Jul 15 14:39:16.746827 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:16.746779    2574 patch_prober.go:28] interesting pod/console-5697cf8ddc-hmdbb container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body=
Jul 15 14:39:16.747006 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:16.746836    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5697cf8ddc-hmdbb" podUID="9a2e641c-2a24-4ebe-be28-ad9a350bbc96" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused"
Jul 15 14:39:16.765140 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:16.765103    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq" event={"ID":"8b1d83ae-11b0-4164-886c-0f11faab6c7b","Type":"ContainerStarted","Data":"e004c7f73e05243281a25a697db6fc290092a1361c71c986cff159d12ae4432c"}
Jul 15 14:39:16.765335 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:16.765237    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"
Jul 15 14:39:16.853957 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:16.853893    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq" podStartSLOduration=1.936272573 podStartE2EDuration="4.853869149s" totalImagesPullingTime="2.917596576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:16.846339906 +0000 UTC m=+516.739444273" watchObservedRunningTime="2026-07-15 14:39:16.853869149 +0000 UTC m=+516.746973516"
Jul 15 14:39:17.074671 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.074640    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"]
Jul 15 14:39:17.074850 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.074827    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25" podUID="282cbf33-6403-467c-a2c3-f121124bf51e" containerName="discovery" containerID="cri-o://67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144" gracePeriod=30
Jul 15 14:39:17.238686 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.238655    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:39:17.325802 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.325783    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-serving-cert\") pod \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") "
Jul 15 14:39:17.325879 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.325830    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-oauth-serving-cert\") pod \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") "
Jul 15 14:39:17.325939 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.325880    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j294r\" (UniqueName: \"kubernetes.io/projected/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-kube-api-access-j294r\") pod \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") "
Jul 15 14:39:17.325939 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.325907    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-service-ca\") pod \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") "
Jul 15 14:39:17.325939 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.325933    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-trusted-ca-bundle\") pod \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") "
Jul 15 14:39:17.326079 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.325978    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-config\") pod \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") "
Jul 15 14:39:17.326079 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.326003    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-oauth-config\") pod \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\" (UID: \"9a2e641c-2a24-4ebe-be28-ad9a350bbc96\") "
Jul 15 14:39:17.326602 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.326569    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a2e641c-2a24-4ebe-be28-ad9a350bbc96" (UID: "9a2e641c-2a24-4ebe-be28-ad9a350bbc96"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:39:17.326602 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.326579    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a2e641c-2a24-4ebe-be28-ad9a350bbc96" (UID: "9a2e641c-2a24-4ebe-be28-ad9a350bbc96"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:39:17.326602 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.326594    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-config" (OuterVolumeSpecName: "console-config") pod "9a2e641c-2a24-4ebe-be28-ad9a350bbc96" (UID: "9a2e641c-2a24-4ebe-be28-ad9a350bbc96"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:39:17.326836 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.326625    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a2e641c-2a24-4ebe-be28-ad9a350bbc96" (UID: "9a2e641c-2a24-4ebe-be28-ad9a350bbc96"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:39:17.328001 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.327934    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a2e641c-2a24-4ebe-be28-ad9a350bbc96" (UID: "9a2e641c-2a24-4ebe-be28-ad9a350bbc96"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:39:17.328173 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.328153    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-kube-api-access-j294r" (OuterVolumeSpecName: "kube-api-access-j294r") pod "9a2e641c-2a24-4ebe-be28-ad9a350bbc96" (UID: "9a2e641c-2a24-4ebe-be28-ad9a350bbc96"). InnerVolumeSpecName "kube-api-access-j294r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:39:17.328408 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.328388    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a2e641c-2a24-4ebe-be28-ad9a350bbc96" (UID: "9a2e641c-2a24-4ebe-be28-ad9a350bbc96"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:39:17.427564 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.427534    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-trusted-ca-bundle\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.427564 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.427562    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-config\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.427763 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.427588    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-oauth-config\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.427763 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.427600    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-console-serving-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.427763 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.427611    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-oauth-serving-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.427763 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.427623    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j294r\" (UniqueName: \"kubernetes.io/projected/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-kube-api-access-j294r\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.427763 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.427634    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a2e641c-2a24-4ebe-be28-ad9a350bbc96-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.523141 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.523116    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:17.628689 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.628620    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/282cbf33-6403-467c-a2c3-f121124bf51e-local-certs\") pod \"282cbf33-6403-467c-a2c3-f121124bf51e\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") "
Jul 15 14:39:17.628689 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.628674    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-dns-cert\") pod \"282cbf33-6403-467c-a2c3-f121124bf51e\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") "
Jul 15 14:39:17.628894 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.628698    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-kubeconfig\") pod \"282cbf33-6403-467c-a2c3-f121124bf51e\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") "
Jul 15 14:39:17.628894 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.628748    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rgzd\" (UniqueName: \"kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-kube-api-access-7rgzd\") pod \"282cbf33-6403-467c-a2c3-f121124bf51e\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") "
Jul 15 14:39:17.628894 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.628770    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-cacerts\") pod \"282cbf33-6403-467c-a2c3-f121124bf51e\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") "
Jul 15 14:39:17.628894 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.628829    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-istio-token\") pod \"282cbf33-6403-467c-a2c3-f121124bf51e\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") "
Jul 15 14:39:17.628894 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.628883    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-ca-configmap\") pod \"282cbf33-6403-467c-a2c3-f121124bf51e\" (UID: \"282cbf33-6403-467c-a2c3-f121124bf51e\") "
Jul 15 14:39:17.629478 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.629444    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "282cbf33-6403-467c-a2c3-f121124bf51e" (UID: "282cbf33-6403-467c-a2c3-f121124bf51e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:39:17.631254 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.631231    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "282cbf33-6403-467c-a2c3-f121124bf51e" (UID: "282cbf33-6403-467c-a2c3-f121124bf51e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:39:17.631407 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.631374    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/282cbf33-6403-467c-a2c3-f121124bf51e-local-certs" (OuterVolumeSpecName: "local-certs") pod "282cbf33-6403-467c-a2c3-f121124bf51e" (UID: "282cbf33-6403-467c-a2c3-f121124bf51e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:39:17.631691 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.631668    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-cacerts" (OuterVolumeSpecName: "cacerts") pod "282cbf33-6403-467c-a2c3-f121124bf51e" (UID: "282cbf33-6403-467c-a2c3-f121124bf51e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:39:17.631777 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.631712    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "282cbf33-6403-467c-a2c3-f121124bf51e" (UID: "282cbf33-6403-467c-a2c3-f121124bf51e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:39:17.631777 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.631715    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-kube-api-access-7rgzd" (OuterVolumeSpecName: "kube-api-access-7rgzd") pod "282cbf33-6403-467c-a2c3-f121124bf51e" (UID: "282cbf33-6403-467c-a2c3-f121124bf51e"). InnerVolumeSpecName "kube-api-access-7rgzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:39:17.631777 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.631733    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-istio-token" (OuterVolumeSpecName: "istio-token") pod "282cbf33-6403-467c-a2c3-f121124bf51e" (UID: "282cbf33-6403-467c-a2c3-f121124bf51e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:39:17.719419 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.719389    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-78lwg"
Jul 15 14:39:17.730092 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.730071    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-dns-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.730229 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.730094    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-istio-kubeconfig\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.730229 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.730109    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rgzd\" (UniqueName: \"kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-kube-api-access-7rgzd\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.730229 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.730122    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/282cbf33-6403-467c-a2c3-f121124bf51e-cacerts\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.730229 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.730150    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/282cbf33-6403-467c-a2c3-f121124bf51e-istio-token\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.730229 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.730163    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/282cbf33-6403-467c-a2c3-f121124bf51e-istio-csr-ca-configmap\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.730229 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.730175    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/282cbf33-6403-467c-a2c3-f121124bf51e-local-certs\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:39:17.770700 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.770669    2574 generic.go:356] "Generic (PLEG): container finished" podID="9a2e641c-2a24-4ebe-be28-ad9a350bbc96" containerID="d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7" exitCode=0
Jul 15 14:39:17.770873 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.770716    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5697cf8ddc-hmdbb"
Jul 15 14:39:17.770873 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.770778    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5697cf8ddc-hmdbb" event={"ID":"9a2e641c-2a24-4ebe-be28-ad9a350bbc96","Type":"ContainerDied","Data":"d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7"}
Jul 15 14:39:17.770873 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.770843    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5697cf8ddc-hmdbb" event={"ID":"9a2e641c-2a24-4ebe-be28-ad9a350bbc96","Type":"ContainerDied","Data":"ceda5bc81116d468df6db91aa4067cc5be0a7433eeb93f0c562c6c7c2c62fccb"}
Jul 15 14:39:17.770873 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.770873    2574 scope.go:117] "RemoveContainer" containerID="d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7"
Jul 15 14:39:17.772805 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.772424    2574 generic.go:356] "Generic (PLEG): container finished" podID="282cbf33-6403-467c-a2c3-f121124bf51e" containerID="67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144" exitCode=0
Jul 15 14:39:17.772805 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.772451    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25" event={"ID":"282cbf33-6403-467c-a2c3-f121124bf51e","Type":"ContainerDied","Data":"67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144"}
Jul 15 14:39:17.772805 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.772488    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"
Jul 15 14:39:17.772805 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.772502    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tz25" event={"ID":"282cbf33-6403-467c-a2c3-f121124bf51e","Type":"ContainerDied","Data":"ac1c62b8a53aa68dfb3f51dc4bc0acc3d4f60bcf0752d2666b3caf128c216365"}
Jul 15 14:39:17.774367 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.774344    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm" event={"ID":"00200266-83dc-421a-8a60-52c89a10f6ea","Type":"ContainerStarted","Data":"6d50f19aca0e3955cfec1ef60402d498b7722b129aa6412dc233b244009ee996"}
Jul 15 14:39:17.774577 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.774502    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"
Jul 15 14:39:17.783415 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.783384    2574 scope.go:117] "RemoveContainer" containerID="d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7"
Jul 15 14:39:17.783682 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:39:17.783657    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7\": container with ID starting with d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7 not found: ID does not exist" containerID="d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7"
Jul 15 14:39:17.783883 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.783689    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7"} err="failed to get container status \"d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7\": rpc error: code = NotFound desc = could not find container \"d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7\": container with ID starting with d4bc80accb718af9c71cd5c2d88845ebbc0927ba0e82507a94378786ca2a87e7 not found: ID does not exist"
Jul 15 14:39:17.783883 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.783707    2574 scope.go:117] "RemoveContainer" containerID="67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144"
Jul 15 14:39:17.791648 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.791626    2574 scope.go:117] "RemoveContainer" containerID="67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144"
Jul 15 14:39:17.791921 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:39:17.791903    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144\": container with ID starting with 67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144 not found: ID does not exist" containerID="67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144"
Jul 15 14:39:17.791983 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.791933    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144"} err="failed to get container status \"67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144\": rpc error: code = NotFound desc = could not find container \"67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144\": container with ID starting with 67f8a4d9f323dd27696921183f167bc95da2fb3909228926156543801b8d7144 not found: ID does not exist"
Jul 15 14:39:17.862809 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.862763    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm" podStartSLOduration=2.800528947 podStartE2EDuration="5.862744672s" totalImagesPullingTime="3.062215725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:39:17.836302584 +0000 UTC m=+517.729406951" watchObservedRunningTime="2026-07-15 14:39:17.862744672 +0000 UTC m=+517.755849094"
Jul 15 14:39:17.864572 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.864551    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5697cf8ddc-hmdbb"]
Jul 15 14:39:17.870835 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.870809    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5697cf8ddc-hmdbb"]
Jul 15 14:39:17.908645 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.908604    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"]
Jul 15 14:39:17.914465 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:17.914430    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tz25"]
Jul 15 14:39:18.652925 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:18.652896    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="282cbf33-6403-467c-a2c3-f121124bf51e" path="/var/lib/kubelet/pods/282cbf33-6403-467c-a2c3-f121124bf51e/volumes"
Jul 15 14:39:18.653329 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:18.653307    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a2e641c-2a24-4ebe-be28-ad9a350bbc96" path="/var/lib/kubelet/pods/9a2e641c-2a24-4ebe-be28-ad9a350bbc96/volumes"
Jul 15 14:39:47.779917 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:47.779887    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jwscq"
Jul 15 14:39:48.783656 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:48.783628    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l92vm"
Jul 15 14:39:58.595645 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.595608    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:58.725781 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.725730    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:58.731999 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.731975    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xwbhb"]
Jul 15 14:39:58.732343 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.732331    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="282cbf33-6403-467c-a2c3-f121124bf51e" containerName="discovery"
Jul 15 14:39:58.732392 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.732346    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="282cbf33-6403-467c-a2c3-f121124bf51e" containerName="discovery"
Jul 15 14:39:58.732392 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.732364    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2e641c-2a24-4ebe-be28-ad9a350bbc96" containerName="console"
Jul 15 14:39:58.732392 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.732370    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2e641c-2a24-4ebe-be28-ad9a350bbc96" containerName="console"
Jul 15 14:39:58.732479 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.732432    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a2e641c-2a24-4ebe-be28-ad9a350bbc96" containerName="console"
Jul 15 14:39:58.732479 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.732445    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="282cbf33-6403-467c-a2c3-f121124bf51e" containerName="discovery"
Jul 15 14:39:58.740334 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.740315    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xwbhb"
Jul 15 14:39:58.743870 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.743848    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 14:39:58.747793 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.747774    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 14:39:58.747973 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.747876    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-67sq2\""
Jul 15 14:39:58.756551 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.756523    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xwbhb"]
Jul 15 14:39:58.885615 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.885536    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvrh8\" (UniqueName: \"kubernetes.io/projected/18ba879d-268d-4b55-b6e3-c11625d23ae8-kube-api-access-bvrh8\") pod \"kuadrant-operator-catalog-xwbhb\" (UID: \"18ba879d-268d-4b55-b6e3-c11625d23ae8\") " pod="kuadrant-system/kuadrant-operator-catalog-xwbhb"
Jul 15 14:39:58.986887 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:58.986853    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvrh8\" (UniqueName: \"kubernetes.io/projected/18ba879d-268d-4b55-b6e3-c11625d23ae8-kube-api-access-bvrh8\") pod \"kuadrant-operator-catalog-xwbhb\" (UID: \"18ba879d-268d-4b55-b6e3-c11625d23ae8\") " pod="kuadrant-system/kuadrant-operator-catalog-xwbhb"
Jul 15 14:39:59.004930 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.004906    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xwbhb"]
Jul 15 14:39:59.005166 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:39:59.005147    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bvrh8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-catalog-xwbhb" podUID="18ba879d-268d-4b55-b6e3-c11625d23ae8"
Jul 15 14:39:59.016687 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.016661    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvrh8\" (UniqueName: \"kubernetes.io/projected/18ba879d-268d-4b55-b6e3-c11625d23ae8-kube-api-access-bvrh8\") pod \"kuadrant-operator-catalog-xwbhb\" (UID: \"18ba879d-268d-4b55-b6e3-c11625d23ae8\") " pod="kuadrant-system/kuadrant-operator-catalog-xwbhb"
Jul 15 14:39:59.165345 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.165313    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:59.243112 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.243081    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zb5m2"]
Jul 15 14:39:59.246049 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.246030    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zb5m2"
Jul 15 14:39:59.259798 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.259774    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zb5m2"]
Jul 15 14:39:59.390052 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.390017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq27n\" (UniqueName: \"kubernetes.io/projected/fbf38cc4-d784-4cb0-a2d0-a1157764b238-kube-api-access-tq27n\") pod \"kuadrant-operator-catalog-zb5m2\" (UID: \"fbf38cc4-d784-4cb0-a2d0-a1157764b238\") " pod="kuadrant-system/kuadrant-operator-catalog-zb5m2"
Jul 15 14:39:59.457904 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.457820    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:59.490558 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.490523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq27n\" (UniqueName: \"kubernetes.io/projected/fbf38cc4-d784-4cb0-a2d0-a1157764b238-kube-api-access-tq27n\") pod \"kuadrant-operator-catalog-zb5m2\" (UID: \"fbf38cc4-d784-4cb0-a2d0-a1157764b238\") " pod="kuadrant-system/kuadrant-operator-catalog-zb5m2"
Jul 15 14:39:59.500034 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.500012    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq27n\" (UniqueName: \"kubernetes.io/projected/fbf38cc4-d784-4cb0-a2d0-a1157764b238-kube-api-access-tq27n\") pod \"kuadrant-operator-catalog-zb5m2\" (UID: \"fbf38cc4-d784-4cb0-a2d0-a1157764b238\") " pod="kuadrant-system/kuadrant-operator-catalog-zb5m2"
Jul 15 14:39:59.555034 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.555002    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zb5m2"
Jul 15 14:39:59.691627 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.691589    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zb5m2"]
Jul 15 14:39:59.692339 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.692302    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:59.693991 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:39:59.693967    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf38cc4_d784_4cb0_a2d0_a1157764b238.slice/crio-b7cf79fa41853d12614aaf715317579349551e39095c974cf54d41dad3ae1600 WatchSource:0}: Error finding container b7cf79fa41853d12614aaf715317579349551e39095c974cf54d41dad3ae1600: Status 404 returned error can't find the container with id b7cf79fa41853d12614aaf715317579349551e39095c974cf54d41dad3ae1600
Jul 15 14:39:59.963800 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.963762    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zb5m2" event={"ID":"fbf38cc4-d784-4cb0-a2d0-a1157764b238","Type":"ContainerStarted","Data":"b7cf79fa41853d12614aaf715317579349551e39095c974cf54d41dad3ae1600"}
Jul 15 14:39:59.963800 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.963792    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xwbhb"
Jul 15 14:39:59.970237 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:39:59.970212    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xwbhb"
Jul 15 14:40:00.095016 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:00.094983    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvrh8\" (UniqueName: \"kubernetes.io/projected/18ba879d-268d-4b55-b6e3-c11625d23ae8-kube-api-access-bvrh8\") pod \"18ba879d-268d-4b55-b6e3-c11625d23ae8\" (UID: \"18ba879d-268d-4b55-b6e3-c11625d23ae8\") "
Jul 15 14:40:00.097105 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:00.097079    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18ba879d-268d-4b55-b6e3-c11625d23ae8-kube-api-access-bvrh8" (OuterVolumeSpecName: "kube-api-access-bvrh8") pod "18ba879d-268d-4b55-b6e3-c11625d23ae8" (UID: "18ba879d-268d-4b55-b6e3-c11625d23ae8"). InnerVolumeSpecName "kube-api-access-bvrh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:40:00.196354 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:00.196322    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvrh8\" (UniqueName: \"kubernetes.io/projected/18ba879d-268d-4b55-b6e3-c11625d23ae8-kube-api-access-bvrh8\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:40:00.968101 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:00.968017    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xwbhb"
Jul 15 14:40:01.027687 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:01.027653    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xwbhb"]
Jul 15 14:40:01.033212 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:01.033168    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xwbhb"]
Jul 15 14:40:02.653564 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:02.653529    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18ba879d-268d-4b55-b6e3-c11625d23ae8" path="/var/lib/kubelet/pods/18ba879d-268d-4b55-b6e3-c11625d23ae8/volumes"
Jul 15 14:40:03.984561 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:03.984526    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zb5m2" event={"ID":"fbf38cc4-d784-4cb0-a2d0-a1157764b238","Type":"ContainerStarted","Data":"00340ac06bb03567fe1a770651041cd58f80de9a2178ae1dd8d6997652e3779c"}
Jul 15 14:40:04.017443 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:04.017386    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zb5m2" podStartSLOduration=1.313264326 podStartE2EDuration="5.017369608s" totalImagesPullingTime="3.704105282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:40:04.015051889 +0000 UTC m=+563.908156265" watchObservedRunningTime="2026-07-15 14:40:04.017369608 +0000 UTC m=+563.910473973"
Jul 15 14:40:09.555754 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:09.555706    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zb5m2"
Jul 15 14:40:09.556191 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:09.555788    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zb5m2"
Jul 15 14:40:09.578382 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:09.578352    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zb5m2"
Jul 15 14:40:10.032223 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:10.032192    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zb5m2"
Jul 15 14:40:28.858746 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:28.858711    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:31.645986 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:31.645950    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn"]
Jul 15 14:40:31.649416 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:31.649400    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn"
Jul 15 14:40:31.654397 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:31.654373    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8wxqf\""
Jul 15 14:40:31.655818 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:31.655376    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 14:40:31.746860 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:31.746829    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb4sp\" (UniqueName: \"kubernetes.io/projected/324342bf-8443-40ae-9605-5a1fd96d61ed-kube-api-access-rb4sp\") pod \"dns-operator-controller-manager-864dd78c4c-kz4qn\" (UID: \"324342bf-8443-40ae-9605-5a1fd96d61ed\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn"
Jul 15 14:40:31.755764 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:31.755734    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn"]
Jul 15 14:40:31.848295 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:31.848263    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4sp\" (UniqueName: \"kubernetes.io/projected/324342bf-8443-40ae-9605-5a1fd96d61ed-kube-api-access-rb4sp\") pod \"dns-operator-controller-manager-864dd78c4c-kz4qn\" (UID: \"324342bf-8443-40ae-9605-5a1fd96d61ed\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn"
Jul 15 14:40:31.881209 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:31.881171    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb4sp\" (UniqueName: \"kubernetes.io/projected/324342bf-8443-40ae-9605-5a1fd96d61ed-kube-api-access-rb4sp\") pod \"dns-operator-controller-manager-864dd78c4c-kz4qn\" (UID: \"324342bf-8443-40ae-9605-5a1fd96d61ed\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn"
Jul 15 14:40:31.959192 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:31.959168    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn"
Jul 15 14:40:32.120541 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:32.120520    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn"]
Jul 15 14:40:32.123035 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:40:32.123006    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324342bf_8443_40ae_9605_5a1fd96d61ed.slice/crio-4003f3877cf593dc436075f3eac70e3df2be41145c9f65fcf93a894e5cf734bf WatchSource:0}: Error finding container 4003f3877cf593dc436075f3eac70e3df2be41145c9f65fcf93a894e5cf734bf: Status 404 returned error can't find the container with id 4003f3877cf593dc436075f3eac70e3df2be41145c9f65fcf93a894e5cf734bf
Jul 15 14:40:32.865464 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:32.865432    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:33.109396 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:33.109358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn" event={"ID":"324342bf-8443-40ae-9605-5a1fd96d61ed","Type":"ContainerStarted","Data":"4003f3877cf593dc436075f3eac70e3df2be41145c9f65fcf93a894e5cf734bf"}
Jul 15 14:40:35.119695 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:35.119600    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn" event={"ID":"324342bf-8443-40ae-9605-5a1fd96d61ed","Type":"ContainerStarted","Data":"d27214b309cd7af2872004a1657401324adcde2cae81269feaa3b9caee054447"}
Jul 15 14:40:35.119695 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:35.119674    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn"
Jul 15 14:40:35.156344 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:35.156299    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn" podStartSLOduration=1.571136125 podStartE2EDuration="4.156283532s" totalImagesPullingTime="2.585147407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:40:35.15447793 +0000 UTC m=+595.047582307" watchObservedRunningTime="2026-07-15 14:40:35.156283532 +0000 UTC m=+595.049387895"
Jul 15 14:40:35.345519 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:35.345484    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:36.844882 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:36.844850    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:37.704485 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:37.704451    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"]
Jul 15 14:40:37.712075 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:37.712051    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:37.715754 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:37.715729    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5vgsk\""
Jul 15 14:40:37.730309 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:37.730285    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"]
Jul 15 14:40:37.796811 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:37.796772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5csd\" (UniqueName: \"kubernetes.io/projected/fe682503-b5ec-4035-8e85-2b63faf9b986-kube-api-access-g5csd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" (UID: \"fe682503-b5ec-4035-8e85-2b63faf9b986\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:37.796948 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:37.796824    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe682503-b5ec-4035-8e85-2b63faf9b986-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" (UID: \"fe682503-b5ec-4035-8e85-2b63faf9b986\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:37.852068 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:37.852036    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:37.898124 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:37.898094    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe682503-b5ec-4035-8e85-2b63faf9b986-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" (UID: \"fe682503-b5ec-4035-8e85-2b63faf9b986\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:37.898285 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:37.898197    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5csd\" (UniqueName: \"kubernetes.io/projected/fe682503-b5ec-4035-8e85-2b63faf9b986-kube-api-access-g5csd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" (UID: \"fe682503-b5ec-4035-8e85-2b63faf9b986\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:37.898475 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:37.898454    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe682503-b5ec-4035-8e85-2b63faf9b986-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" (UID: \"fe682503-b5ec-4035-8e85-2b63faf9b986\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:37.919661 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:37.919631    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5csd\" (UniqueName: \"kubernetes.io/projected/fe682503-b5ec-4035-8e85-2b63faf9b986-kube-api-access-g5csd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" (UID: \"fe682503-b5ec-4035-8e85-2b63faf9b986\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:38.023113 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:38.023023    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:38.169599 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:38.169571    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"]
Jul 15 14:40:38.172792 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:40:38.172765    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe682503_b5ec_4035_8e85_2b63faf9b986.slice/crio-5218e5c997b14738b7c77ec534288c0c9bf309b82fca951047489b8861114977 WatchSource:0}: Error finding container 5218e5c997b14738b7c77ec534288c0c9bf309b82fca951047489b8861114977: Status 404 returned error can't find the container with id 5218e5c997b14738b7c77ec534288c0c9bf309b82fca951047489b8861114977
Jul 15 14:40:39.138208 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:39.138170    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt" event={"ID":"fe682503-b5ec-4035-8e85-2b63faf9b986","Type":"ContainerStarted","Data":"5218e5c997b14738b7c77ec534288c0c9bf309b82fca951047489b8861114977"}
Jul 15 14:40:39.570013 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:39.569977    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"]
Jul 15 14:40:39.574289 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:39.574263    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:40:39.582504 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:39.582476    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-j8fw9\""
Jul 15 14:40:39.603321 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:39.603273    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"]
Jul 15 14:40:39.613478 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:39.613452    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsdqr\" (UniqueName: \"kubernetes.io/projected/22509153-f33c-4769-8340-8d3aaeb3ae5b-kube-api-access-rsdqr\") pod \"limitador-operator-controller-manager-859d7b78bd-wpmv8\" (UID: \"22509153-f33c-4769-8340-8d3aaeb3ae5b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:40:39.713969 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:39.713930    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdqr\" (UniqueName: \"kubernetes.io/projected/22509153-f33c-4769-8340-8d3aaeb3ae5b-kube-api-access-rsdqr\") pod \"limitador-operator-controller-manager-859d7b78bd-wpmv8\" (UID: \"22509153-f33c-4769-8340-8d3aaeb3ae5b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:40:39.736445 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:39.736411    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsdqr\" (UniqueName: \"kubernetes.io/projected/22509153-f33c-4769-8340-8d3aaeb3ae5b-kube-api-access-rsdqr\") pod \"limitador-operator-controller-manager-859d7b78bd-wpmv8\" (UID: \"22509153-f33c-4769-8340-8d3aaeb3ae5b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:40:39.884770 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:39.884661    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:39.888688 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:39.888658    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:40:40.038029 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:40.038006    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"]
Jul 15 14:40:40.040710 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:40:40.040681    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22509153_f33c_4769_8340_8d3aaeb3ae5b.slice/crio-4389b02f5ec3c968d7c1e1d04385170c6de903b15d82764362a56658f91f24ca WatchSource:0}: Error finding container 4389b02f5ec3c968d7c1e1d04385170c6de903b15d82764362a56658f91f24ca: Status 404 returned error can't find the container with id 4389b02f5ec3c968d7c1e1d04385170c6de903b15d82764362a56658f91f24ca
Jul 15 14:40:40.143998 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:40.143906    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8" event={"ID":"22509153-f33c-4769-8340-8d3aaeb3ae5b","Type":"ContainerStarted","Data":"4389b02f5ec3c968d7c1e1d04385170c6de903b15d82764362a56658f91f24ca"}
Jul 15 14:40:40.274797 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:40.274763    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:40.878648 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:40.878606    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:43.161522 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:43.161488    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8" event={"ID":"22509153-f33c-4769-8340-8d3aaeb3ae5b","Type":"ContainerStarted","Data":"5d104cb1241255897ea66aa4a29746e6597e17be5cf0f083a577278099fa94ff"}
Jul 15 14:40:43.163299 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:43.161571    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:40:43.203253 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:43.203217    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:43.208546 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:43.208508    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8" podStartSLOduration=1.707118605 podStartE2EDuration="4.20849383s" totalImagesPullingTime="2.501375225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:40:43.20642385 +0000 UTC m=+603.099528243" watchObservedRunningTime="2026-07-15 14:40:43.20849383 +0000 UTC m=+603.101598194"
Jul 15 14:40:43.409845 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:43.409797    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:44.021679 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:44.021648    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bftj6"]
Jul 15 14:40:44.025100 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:44.025080    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bftj6"
Jul 15 14:40:44.028455 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:44.028437    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-swkqd\""
Jul 15 14:40:44.050356 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:44.050331    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bftj6"]
Jul 15 14:40:44.155839 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:44.155807    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z6v5\" (UniqueName: \"kubernetes.io/projected/3f052848-97d5-4c8b-8aa5-9ee26e6ef241-kube-api-access-7z6v5\") pod \"authorino-operator-75cc8d5cb7-bftj6\" (UID: \"3f052848-97d5-4c8b-8aa5-9ee26e6ef241\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bftj6"
Jul 15 14:40:44.256353 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:44.256314    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z6v5\" (UniqueName: \"kubernetes.io/projected/3f052848-97d5-4c8b-8aa5-9ee26e6ef241-kube-api-access-7z6v5\") pod \"authorino-operator-75cc8d5cb7-bftj6\" (UID: \"3f052848-97d5-4c8b-8aa5-9ee26e6ef241\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bftj6"
Jul 15 14:40:44.281508 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:44.281425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z6v5\" (UniqueName: \"kubernetes.io/projected/3f052848-97d5-4c8b-8aa5-9ee26e6ef241-kube-api-access-7z6v5\") pod \"authorino-operator-75cc8d5cb7-bftj6\" (UID: \"3f052848-97d5-4c8b-8aa5-9ee26e6ef241\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bftj6"
Jul 15 14:40:44.336731 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:44.336695    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bftj6"
Jul 15 14:40:44.777307 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:44.777268    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:45.317870 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:45.317843    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bftj6"]
Jul 15 14:40:45.320800 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:40:45.320777    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f052848_97d5_4c8b_8aa5_9ee26e6ef241.slice/crio-5ff2bae788e10b2e6257d46a4a7fc2da84b98e910da81a1bc0c42013b9759644 WatchSource:0}: Error finding container 5ff2bae788e10b2e6257d46a4a7fc2da84b98e910da81a1bc0c42013b9759644: Status 404 returned error can't find the container with id 5ff2bae788e10b2e6257d46a4a7fc2da84b98e910da81a1bc0c42013b9759644
Jul 15 14:40:46.126690 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:46.126652    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kz4qn"
Jul 15 14:40:46.188699 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:46.188659    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt" event={"ID":"fe682503-b5ec-4035-8e85-2b63faf9b986","Type":"ContainerStarted","Data":"b632f35a620794f2b31ab0b612726b7e72262ba8d8840d1c03d581487e11521d"}
Jul 15 14:40:46.188877 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:46.188765    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:46.190456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:46.190404    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bftj6" event={"ID":"3f052848-97d5-4c8b-8aa5-9ee26e6ef241","Type":"ContainerStarted","Data":"5ff2bae788e10b2e6257d46a4a7fc2da84b98e910da81a1bc0c42013b9759644"}
Jul 15 14:40:46.223880 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:46.223827    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt" podStartSLOduration=2.174258935 podStartE2EDuration="9.223804441s" totalImagesPullingTime="7.049545506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:40:46.220449797 +0000 UTC m=+606.113554164" watchObservedRunningTime="2026-07-15 14:40:46.223804441 +0000 UTC m=+606.116908808"
Jul 15 14:40:48.202376 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.202343    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bftj6" event={"ID":"3f052848-97d5-4c8b-8aa5-9ee26e6ef241","Type":"ContainerStarted","Data":"c39aa436a16398effb4b5a60b865634a54f2d01ae3e6439607de39ef0b536eee"}
Jul 15 14:40:48.202746 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.202475    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bftj6"
Jul 15 14:40:48.221049 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.221012    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:48.226501 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.226464    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bftj6" podStartSLOduration=3.082462088 podStartE2EDuration="5.22645071s" totalImagesPullingTime="2.143988622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:40:48.224563478 +0000 UTC m=+608.117667842" watchObservedRunningTime="2026-07-15 14:40:48.22645071 +0000 UTC m=+608.119555074"
Jul 15 14:40:48.428481 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.428439    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:48.436821 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.436795    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"]
Jul 15 14:40:48.440342 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.440323    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"
Jul 15 14:40:48.443360 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.443337    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rpvvg\""
Jul 15 14:40:48.443476 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.443381    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 14:40:48.443476 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.443381    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 14:40:48.456881 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.456824    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"]
Jul 15 14:40:48.500441 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.500411    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da64d1f6-668f-4e87-8db9-e9bbfe4cdecb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-774sg\" (UID: \"da64d1f6-668f-4e87-8db9-e9bbfe4cdecb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"
Jul 15 14:40:48.500623 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.500468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfkcj\" (UniqueName: \"kubernetes.io/projected/da64d1f6-668f-4e87-8db9-e9bbfe4cdecb-kube-api-access-xfkcj\") pod \"kuadrant-console-plugin-66b5774985-774sg\" (UID: \"da64d1f6-668f-4e87-8db9-e9bbfe4cdecb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"
Jul 15 14:40:48.500623 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.500493    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da64d1f6-668f-4e87-8db9-e9bbfe4cdecb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-774sg\" (UID: \"da64d1f6-668f-4e87-8db9-e9bbfe4cdecb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"
Jul 15 14:40:48.601442 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.601409    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfkcj\" (UniqueName: \"kubernetes.io/projected/da64d1f6-668f-4e87-8db9-e9bbfe4cdecb-kube-api-access-xfkcj\") pod \"kuadrant-console-plugin-66b5774985-774sg\" (UID: \"da64d1f6-668f-4e87-8db9-e9bbfe4cdecb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"
Jul 15 14:40:48.601597 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.601450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da64d1f6-668f-4e87-8db9-e9bbfe4cdecb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-774sg\" (UID: \"da64d1f6-668f-4e87-8db9-e9bbfe4cdecb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"
Jul 15 14:40:48.601597 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.601514    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da64d1f6-668f-4e87-8db9-e9bbfe4cdecb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-774sg\" (UID: \"da64d1f6-668f-4e87-8db9-e9bbfe4cdecb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"
Jul 15 14:40:48.602261 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.602239    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/da64d1f6-668f-4e87-8db9-e9bbfe4cdecb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-774sg\" (UID: \"da64d1f6-668f-4e87-8db9-e9bbfe4cdecb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"
Jul 15 14:40:48.603795 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.603774    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/da64d1f6-668f-4e87-8db9-e9bbfe4cdecb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-774sg\" (UID: \"da64d1f6-668f-4e87-8db9-e9bbfe4cdecb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"
Jul 15 14:40:48.633620 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.633596    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfkcj\" (UniqueName: \"kubernetes.io/projected/da64d1f6-668f-4e87-8db9-e9bbfe4cdecb-kube-api-access-xfkcj\") pod \"kuadrant-console-plugin-66b5774985-774sg\" (UID: \"da64d1f6-668f-4e87-8db9-e9bbfe4cdecb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"
Jul 15 14:40:48.749849 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.749775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"
Jul 15 14:40:48.905316 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:48.905244    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-774sg"]
Jul 15 14:40:48.908150 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:40:48.908098    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda64d1f6_668f_4e87_8db9_e9bbfe4cdecb.slice/crio-24c126d9795cd9ec037790cd82924e9298a21483377599cb5fc9dd4b3d1659fd WatchSource:0}: Error finding container 24c126d9795cd9ec037790cd82924e9298a21483377599cb5fc9dd4b3d1659fd: Status 404 returned error can't find the container with id 24c126d9795cd9ec037790cd82924e9298a21483377599cb5fc9dd4b3d1659fd
Jul 15 14:40:49.003270 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:49.003185    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:49.091283 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:49.091253    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:49.207676 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:49.207644    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg" event={"ID":"da64d1f6-668f-4e87-8db9-e9bbfe4cdecb","Type":"ContainerStarted","Data":"24c126d9795cd9ec037790cd82924e9298a21483377599cb5fc9dd4b3d1659fd"}
Jul 15 14:40:54.177805 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:54.177778    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:40:55.829059 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:55.828995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:56.230048 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:56.230001    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:56.497869 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:56.497766    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:56.732962 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:56.732921    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:57.198579 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:57.198550    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:59.210655 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.210621    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bftj6"
Jul 15 14:40:59.506548 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.506464    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"]
Jul 15 14:40:59.506751 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.506691    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" containerName="manager" containerID="cri-o://b632f35a620794f2b31ab0b612726b7e72262ba8d8840d1c03d581487e11521d" gracePeriod=2
Jul 15 14:40:59.534842 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.534814    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"]
Jul 15 14:40:59.546013 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:40:59.545971    2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fe682503-b5ec-4035-8e85-2b63faf9b986\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\": pods \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:59.580173 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.580147    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"]
Jul 15 14:40:59.580370 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.580334    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" containerName="manager" containerID="cri-o://5d104cb1241255897ea66aa4a29746e6597e17be5cf0f083a577278099fa94ff" gracePeriod=2
Jul 15 14:40:59.585708 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.585684    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"]
Jul 15 14:40:59.590124 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.590101    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"]
Jul 15 14:40:59.590520 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.590501    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" containerName="manager"
Jul 15 14:40:59.590604 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.590521    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" containerName="manager"
Jul 15 14:40:59.590604 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.590553    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" containerName="manager"
Jul 15 14:40:59.590604 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.590561    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" containerName="manager"
Jul 15 14:40:59.590750 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.590647    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" containerName="manager"
Jul 15 14:40:59.590750 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.590664    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" containerName="manager"
Jul 15 14:40:59.593733 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:40:59.593699    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:59.593733 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.593713    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:40:59.599443 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:40:59.599411    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:59.638572 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.638542    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"]
Jul 15 14:40:59.682555 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.682526    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6"]
Jul 15 14:40:59.688012 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.687988    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6"
Jul 15 14:40:59.705304 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.705276    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp6jg\" (UniqueName: \"kubernetes.io/projected/59a759d8-7c16-4d2c-af75-a6718f5cec3a-kube-api-access-kp6jg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58rtv\" (UID: \"59a759d8-7c16-4d2c-af75-a6718f5cec3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:40:59.705430 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.705316    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59a759d8-7c16-4d2c-af75-a6718f5cec3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58rtv\" (UID: \"59a759d8-7c16-4d2c-af75-a6718f5cec3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:40:59.729541 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.729514    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6"]
Jul 15 14:40:59.734512 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:40:59.734480    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wpmv8\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:40:59.745632 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:40:59.745590    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:40:59.748952 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:40:59.748918    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wpmv8\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:40:59.806489 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.806410    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6jg\" (UniqueName: \"kubernetes.io/projected/59a759d8-7c16-4d2c-af75-a6718f5cec3a-kube-api-access-kp6jg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58rtv\" (UID: \"59a759d8-7c16-4d2c-af75-a6718f5cec3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:40:59.806489 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.806458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59a759d8-7c16-4d2c-af75-a6718f5cec3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58rtv\" (UID: \"59a759d8-7c16-4d2c-af75-a6718f5cec3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:40:59.806738 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.806534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q6s5\" (UniqueName: \"kubernetes.io/projected/440f6573-7ced-44c5-919d-fb7b50d79799-kube-api-access-9q6s5\") pod \"limitador-operator-controller-manager-859d7b78bd-xkgb6\" (UID: \"440f6573-7ced-44c5-919d-fb7b50d79799\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6"
Jul 15 14:40:59.806846 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.806826    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59a759d8-7c16-4d2c-af75-a6718f5cec3a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58rtv\" (UID: \"59a759d8-7c16-4d2c-af75-a6718f5cec3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:40:59.822628 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.822599    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp6jg\" (UniqueName: \"kubernetes.io/projected/59a759d8-7c16-4d2c-af75-a6718f5cec3a-kube-api-access-kp6jg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58rtv\" (UID: \"59a759d8-7c16-4d2c-af75-a6718f5cec3a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:40:59.907469 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.907431    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q6s5\" (UniqueName: \"kubernetes.io/projected/440f6573-7ced-44c5-919d-fb7b50d79799-kube-api-access-9q6s5\") pod \"limitador-operator-controller-manager-859d7b78bd-xkgb6\" (UID: \"440f6573-7ced-44c5-919d-fb7b50d79799\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6"
Jul 15 14:40:59.923076 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.923046    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q6s5\" (UniqueName: \"kubernetes.io/projected/440f6573-7ced-44c5-919d-fb7b50d79799-kube-api-access-9q6s5\") pod \"limitador-operator-controller-manager-859d7b78bd-xkgb6\" (UID: \"440f6573-7ced-44c5-919d-fb7b50d79799\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6"
Jul 15 14:40:59.958806 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.958764    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:40:59.999738 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:40:59.999703    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6"
Jul 15 14:41:00.266982 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:00.266948    2574 generic.go:356] "Generic (PLEG): container finished" podID="fe682503-b5ec-4035-8e85-2b63faf9b986" containerID="b632f35a620794f2b31ab0b612726b7e72262ba8d8840d1c03d581487e11521d" exitCode=0
Jul 15 14:41:00.269012 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:00.268981    2574 generic.go:356] "Generic (PLEG): container finished" podID="22509153-f33c-4769-8340-8d3aaeb3ae5b" containerID="5d104cb1241255897ea66aa4a29746e6597e17be5cf0f083a577278099fa94ff" exitCode=0
Jul 15 14:41:00.658438 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:00.658397    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:41:00.661333 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:00.661303    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wpmv8\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:41:01.007595 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:01.007489    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:01.272905 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:01.272800    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:01.677037 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:01.676995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:01.926338 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:01.926301    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:02.803598 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:02.803565    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"]
Jul 15 14:41:02.836588 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:02.836555    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:41:02.869959 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:02.869929    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"]
Jul 15 14:41:02.934944 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:02.934913    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9hsq\" (UniqueName: \"kubernetes.io/projected/de09904b-d4d0-4d79-9231-310c2d020f28-kube-api-access-z9hsq\") pod \"kuadrant-operator-controller-manager-86878c769f-bzz4q\" (UID: \"de09904b-d4d0-4d79-9231-310c2d020f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:41:02.935111 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:02.934953    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de09904b-d4d0-4d79-9231-310c2d020f28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bzz4q\" (UID: \"de09904b-d4d0-4d79-9231-310c2d020f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:41:03.036055 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:03.036019    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9hsq\" (UniqueName: \"kubernetes.io/projected/de09904b-d4d0-4d79-9231-310c2d020f28-kube-api-access-z9hsq\") pod \"kuadrant-operator-controller-manager-86878c769f-bzz4q\" (UID: \"de09904b-d4d0-4d79-9231-310c2d020f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:41:03.036258 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:03.036072    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de09904b-d4d0-4d79-9231-310c2d020f28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bzz4q\" (UID: \"de09904b-d4d0-4d79-9231-310c2d020f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:41:03.036454 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:03.036432    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de09904b-d4d0-4d79-9231-310c2d020f28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bzz4q\" (UID: \"de09904b-d4d0-4d79-9231-310c2d020f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:41:03.057428 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:03.057361    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9hsq\" (UniqueName: \"kubernetes.io/projected/de09904b-d4d0-4d79-9231-310c2d020f28-kube-api-access-z9hsq\") pod \"kuadrant-operator-controller-manager-86878c769f-bzz4q\" (UID: \"de09904b-d4d0-4d79-9231-310c2d020f28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:41:03.150585 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:03.150543    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:41:06.996405 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:06.996364    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:07.197324 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:07.197273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:11.159192 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:11.159151    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:11.263673 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:11.263639    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:13.887026 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:13.886923    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:41:13.895446 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:13.895396    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:41:13.899351 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:13.899294    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:41:13.904362 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:13.904332    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:41:13.916402 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:13.916373    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wpmv8\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:41:13.928661 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:13.928634    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsdqr\" (UniqueName: \"kubernetes.io/projected/22509153-f33c-4769-8340-8d3aaeb3ae5b-kube-api-access-rsdqr\") pod \"22509153-f33c-4769-8340-8d3aaeb3ae5b\" (UID: \"22509153-f33c-4769-8340-8d3aaeb3ae5b\") "
Jul 15 14:41:13.928790 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:13.928770    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe682503-b5ec-4035-8e85-2b63faf9b986-extensions-socket-volume\") pod \"fe682503-b5ec-4035-8e85-2b63faf9b986\" (UID: \"fe682503-b5ec-4035-8e85-2b63faf9b986\") "
Jul 15 14:41:13.928874 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:13.928862    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5csd\" (UniqueName: \"kubernetes.io/projected/fe682503-b5ec-4035-8e85-2b63faf9b986-kube-api-access-g5csd\") pod \"fe682503-b5ec-4035-8e85-2b63faf9b986\" (UID: \"fe682503-b5ec-4035-8e85-2b63faf9b986\") "
Jul 15 14:41:13.929215 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:13.929193    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe682503-b5ec-4035-8e85-2b63faf9b986-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fe682503-b5ec-4035-8e85-2b63faf9b986" (UID: "fe682503-b5ec-4035-8e85-2b63faf9b986"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:41:13.930639 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:13.930614    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22509153-f33c-4769-8340-8d3aaeb3ae5b-kube-api-access-rsdqr" (OuterVolumeSpecName: "kube-api-access-rsdqr") pod "22509153-f33c-4769-8340-8d3aaeb3ae5b" (UID: "22509153-f33c-4769-8340-8d3aaeb3ae5b"). InnerVolumeSpecName "kube-api-access-rsdqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:41:13.930726 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:13.930683    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe682503-b5ec-4035-8e85-2b63faf9b986-kube-api-access-g5csd" (OuterVolumeSpecName: "kube-api-access-g5csd") pod "fe682503-b5ec-4035-8e85-2b63faf9b986" (UID: "fe682503-b5ec-4035-8e85-2b63faf9b986"). InnerVolumeSpecName "kube-api-access-g5csd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:41:13.939357 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:13.939336    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6"]
Jul 15 14:41:13.973077 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:41:13.973051    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440f6573_7ced_44c5_919d_fb7b50d79799.slice/crio-3b69927667e0357654713feaf08660c217448fc27daa65e31d6f8386753b1758 WatchSource:0}: Error finding container 3b69927667e0357654713feaf08660c217448fc27daa65e31d6f8386753b1758: Status 404 returned error can't find the container with id 3b69927667e0357654713feaf08660c217448fc27daa65e31d6f8386753b1758
Jul 15 14:41:14.029458 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.029436    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5csd\" (UniqueName: \"kubernetes.io/projected/fe682503-b5ec-4035-8e85-2b63faf9b986-kube-api-access-g5csd\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:41:14.029458 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.029460    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsdqr\" (UniqueName: \"kubernetes.io/projected/22509153-f33c-4769-8340-8d3aaeb3ae5b-kube-api-access-rsdqr\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:41:14.029580 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.029470    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe682503-b5ec-4035-8e85-2b63faf9b986-extensions-socket-volume\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:41:14.039209 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.039180    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"]
Jul 15 14:41:14.043715 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.043692    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"]
Jul 15 14:41:14.052711 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:41:14.052687    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde09904b_d4d0_4d79_9231_310c2d020f28.slice/crio-6e7a8a1f7288292ecb77dfeee24a9cc08155ac9aa98ee6bf45c2b04497ecbb01 WatchSource:0}: Error finding container 6e7a8a1f7288292ecb77dfeee24a9cc08155ac9aa98ee6bf45c2b04497ecbb01: Status 404 returned error can't find the container with id 6e7a8a1f7288292ecb77dfeee24a9cc08155ac9aa98ee6bf45c2b04497ecbb01
Jul 15 14:41:14.053769 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:41:14.053746    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a759d8_7c16_4d2c_af75_a6718f5cec3a.slice/crio-a30da6e5074daff86399a2ed19e364944543832a9d2361ef8cbab1fb752af355 WatchSource:0}: Error finding container a30da6e5074daff86399a2ed19e364944543832a9d2361ef8cbab1fb752af355: Status 404 returned error can't find the container with id a30da6e5074daff86399a2ed19e364944543832a9d2361ef8cbab1fb752af355
Jul 15 14:41:14.360575 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.360501    2574 scope.go:117] "RemoveContainer" containerID="5d104cb1241255897ea66aa4a29746e6597e17be5cf0f083a577278099fa94ff"
Jul 15 14:41:14.360720 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.360501    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:41:14.362181 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.362156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg" event={"ID":"da64d1f6-668f-4e87-8db9-e9bbfe4cdecb","Type":"ContainerStarted","Data":"4ab1c2c638b658b7cf740b5383013956ccc403ab489c2da2419dcffdf072c554"}
Jul 15 14:41:14.363666 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:14.363639    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:41:14.363791 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.363779    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:41:14.365525 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.365500    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q" event={"ID":"de09904b-d4d0-4d79-9231-310c2d020f28","Type":"ContainerStarted","Data":"a8b0dfb5b044ea956b659ea88a7dcbc6dfa03b10a22fa50162323b86290e0524"}
Jul 15 14:41:14.365636 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.365549    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q" event={"ID":"de09904b-d4d0-4d79-9231-310c2d020f28","Type":"ContainerStarted","Data":"6e7a8a1f7288292ecb77dfeee24a9cc08155ac9aa98ee6bf45c2b04497ecbb01"}
Jul 15 14:41:14.365636 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.365602    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:41:14.367185 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.367158    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv" event={"ID":"59a759d8-7c16-4d2c-af75-a6718f5cec3a","Type":"ContainerStarted","Data":"52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140"}
Jul 15 14:41:14.367321 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.367216    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv" event={"ID":"59a759d8-7c16-4d2c-af75-a6718f5cec3a","Type":"ContainerStarted","Data":"a30da6e5074daff86399a2ed19e364944543832a9d2361ef8cbab1fb752af355"}
Jul 15 14:41:14.367321 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.367261    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:41:14.367427 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:14.367340    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wpmv8\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:41:14.368944 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.368627    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6" event={"ID":"440f6573-7ced-44c5-919d-fb7b50d79799","Type":"ContainerStarted","Data":"cddc89e8c1c12e4f1c25f206e7418d04cb963747e598d61b8d4a7b89336ba59d"}
Jul 15 14:41:14.368944 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.368660    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6" event={"ID":"440f6573-7ced-44c5-919d-fb7b50d79799","Type":"ContainerStarted","Data":"3b69927667e0357654713feaf08660c217448fc27daa65e31d6f8386753b1758"}
Jul 15 14:41:14.368944 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.368703    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6"
Jul 15 14:41:14.370383 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.370361    2574 scope.go:117] "RemoveContainer" containerID="b632f35a620794f2b31ab0b612726b7e72262ba8d8840d1c03d581487e11521d"
Jul 15 14:41:14.370925 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:14.370901    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wpmv8\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:41:14.436444 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.436331    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q" podStartSLOduration=12.43631059 podStartE2EDuration="12.43631059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:41:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:41:14.432864862 +0000 UTC m=+634.325969242" watchObservedRunningTime="2026-07-15 14:41:14.43631059 +0000 UTC m=+634.329414956"
Jul 15 14:41:14.504309 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:14.504249    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:41:14.555933 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.555875    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-774sg" podStartSLOduration=1.644252114 podStartE2EDuration="26.555849799s" totalImagesPullingTime="24.911597685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:41:14.494345327 +0000 UTC m=+634.387449694" watchObservedRunningTime="2026-07-15 14:41:14.555849799 +0000 UTC m=+634.448954166"
Jul 15 14:41:14.556206 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.556118    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv" podStartSLOduration=15.556109435 podStartE2EDuration="15.556109435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:40:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:41:14.555320106 +0000 UTC m=+634.448424481" watchObservedRunningTime="2026-07-15 14:41:14.556109435 +0000 UTC m=+634.449213802"
Jul 15 14:41:14.559262 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:14.559226    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k6zpt\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k6zpt"
Jul 15 14:41:14.563520 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:14.563491    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wpmv8\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wpmv8"
Jul 15 14:41:14.611507 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.611408    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6" podStartSLOduration=15.611391609 podStartE2EDuration="15.611391609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:40:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:41:14.61084561 +0000 UTC m=+634.503949976" watchObservedRunningTime="2026-07-15 14:41:14.611391609 +0000 UTC m=+634.504495973"
Jul 15 14:41:14.652611 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.652565    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22509153-f33c-4769-8340-8d3aaeb3ae5b" path="/var/lib/kubelet/pods/22509153-f33c-4769-8340-8d3aaeb3ae5b/volumes"
Jul 15 14:41:14.652994 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:14.652975    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe682503-b5ec-4035-8e85-2b63faf9b986" path="/var/lib/kubelet/pods/fe682503-b5ec-4035-8e85-2b63faf9b986/volumes"
Jul 15 14:41:19.822535 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:19.822500    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:20.022845 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:20.022818    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:24.568168 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:24.568125    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:24.717309 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:24.717252    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:24.864952 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:24.864857    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:25.378346 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.378312    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xkgb6"
Jul 15 14:41:25.378544 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.378388    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:41:25.378613 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.378556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:41:25.507967 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.507939    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"]
Jul 15 14:41:25.508122 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.508101    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv" podUID="59a759d8-7c16-4d2c-af75-a6718f5cec3a" containerName="manager" containerID="cri-o://52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140" gracePeriod=10
Jul 15 14:41:25.746830 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.746808    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:41:25.825105 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.825074    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59a759d8-7c16-4d2c-af75-a6718f5cec3a-extensions-socket-volume\") pod \"59a759d8-7c16-4d2c-af75-a6718f5cec3a\" (UID: \"59a759d8-7c16-4d2c-af75-a6718f5cec3a\") "
Jul 15 14:41:25.825313 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.825215    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp6jg\" (UniqueName: \"kubernetes.io/projected/59a759d8-7c16-4d2c-af75-a6718f5cec3a-kube-api-access-kp6jg\") pod \"59a759d8-7c16-4d2c-af75-a6718f5cec3a\" (UID: \"59a759d8-7c16-4d2c-af75-a6718f5cec3a\") "
Jul 15 14:41:25.825498 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.825474    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59a759d8-7c16-4d2c-af75-a6718f5cec3a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "59a759d8-7c16-4d2c-af75-a6718f5cec3a" (UID: "59a759d8-7c16-4d2c-af75-a6718f5cec3a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:41:25.827248 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.827221    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59a759d8-7c16-4d2c-af75-a6718f5cec3a-kube-api-access-kp6jg" (OuterVolumeSpecName: "kube-api-access-kp6jg") pod "59a759d8-7c16-4d2c-af75-a6718f5cec3a" (UID: "59a759d8-7c16-4d2c-af75-a6718f5cec3a"). InnerVolumeSpecName "kube-api-access-kp6jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:41:25.926316 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.926247    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp6jg\" (UniqueName: \"kubernetes.io/projected/59a759d8-7c16-4d2c-af75-a6718f5cec3a-kube-api-access-kp6jg\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:41:25.926316 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:25.926268    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/59a759d8-7c16-4d2c-af75-a6718f5cec3a-extensions-socket-volume\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:41:26.429909 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:26.429879    2574 generic.go:356] "Generic (PLEG): container finished" podID="59a759d8-7c16-4d2c-af75-a6718f5cec3a" containerID="52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140" exitCode=0
Jul 15 14:41:26.430078 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:26.429927    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"
Jul 15 14:41:26.430078 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:26.429970    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv" event={"ID":"59a759d8-7c16-4d2c-af75-a6718f5cec3a","Type":"ContainerDied","Data":"52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140"}
Jul 15 14:41:26.430078 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:26.430028    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv" event={"ID":"59a759d8-7c16-4d2c-af75-a6718f5cec3a","Type":"ContainerDied","Data":"a30da6e5074daff86399a2ed19e364944543832a9d2361ef8cbab1fb752af355"}
Jul 15 14:41:26.430280 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:26.430055    2574 scope.go:117] "RemoveContainer" containerID="52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140"
Jul 15 14:41:26.439056 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:26.439038    2574 scope.go:117] "RemoveContainer" containerID="52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140"
Jul 15 14:41:26.439369 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:26.439350    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140\": container with ID starting with 52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140 not found: ID does not exist" containerID="52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140"
Jul 15 14:41:26.439440 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:26.439378    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140"} err="failed to get container status \"52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140\": rpc error: code = NotFound desc = could not find container \"52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140\": container with ID starting with 52e68924635c5ebc4449fa6eece9a6a28d2fb8c008a43f811dad5ad2a8671140 not found: ID does not exist"
Jul 15 14:41:26.471610 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:26.471557    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"]
Jul 15 14:41:26.473562 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:26.473541    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58rtv"]
Jul 15 14:41:26.652671 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:26.652637    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59a759d8-7c16-4d2c-af75-a6718f5cec3a" path="/var/lib/kubelet/pods/59a759d8-7c16-4d2c-af75-a6718f5cec3a/volumes"
Jul 15 14:41:42.138556 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:42.138522    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:42.607233 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:42.607193    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:43.834115 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:43.834072    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:44.024122 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.024090    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:44.599381 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.599351    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"]
Jul 15 14:41:44.599712 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.599701    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59a759d8-7c16-4d2c-af75-a6718f5cec3a" containerName="manager"
Jul 15 14:41:44.599760 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.599714    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="59a759d8-7c16-4d2c-af75-a6718f5cec3a" containerName="manager"
Jul 15 14:41:44.599808 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.599799    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="59a759d8-7c16-4d2c-af75-a6718f5cec3a" containerName="manager"
Jul 15 14:41:44.604421 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.604398    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:44.685178 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.685122    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:41:44.688501 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.688474    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 14:41:44.691962 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.691935    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"]
Jul 15 14:41:44.692089 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.691985    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"]
Jul 15 14:41:44.786563 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.786530    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwt46\" (UniqueName: \"kubernetes.io/projected/2865934b-c991-43c2-a1cb-bc40e357b856-kube-api-access-wwt46\") pod \"limitador-limitador-64c94fd64f-bb5dz\" (UID: \"2865934b-c991-43c2-a1cb-bc40e357b856\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:41:44.786765 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.786573    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2865934b-c991-43c2-a1cb-bc40e357b856-config-file\") pod \"limitador-limitador-64c94fd64f-bb5dz\" (UID: \"2865934b-c991-43c2-a1cb-bc40e357b856\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:41:44.888288 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.888201    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwt46\" (UniqueName: \"kubernetes.io/projected/2865934b-c991-43c2-a1cb-bc40e357b856-kube-api-access-wwt46\") pod \"limitador-limitador-64c94fd64f-bb5dz\" (UID: \"2865934b-c991-43c2-a1cb-bc40e357b856\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:41:44.888288 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.888244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2865934b-c991-43c2-a1cb-bc40e357b856-config-file\") pod \"limitador-limitador-64c94fd64f-bb5dz\" (UID: \"2865934b-c991-43c2-a1cb-bc40e357b856\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:41:44.889309 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.889281    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2865934b-c991-43c2-a1cb-bc40e357b856-config-file\") pod \"limitador-limitador-64c94fd64f-bb5dz\" (UID: \"2865934b-c991-43c2-a1cb-bc40e357b856\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:41:44.901140 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.901100    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwt46\" (UniqueName: \"kubernetes.io/projected/2865934b-c991-43c2-a1cb-bc40e357b856-kube-api-access-wwt46\") pod \"limitador-limitador-64c94fd64f-bb5dz\" (UID: \"2865934b-c991-43c2-a1cb-bc40e357b856\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:41:44.997066 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:44.997028    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:41:45.141705 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.141680    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"]
Jul 15 14:41:45.144071 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:41:45.144039    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2865934b_c991_43c2_a1cb_bc40e357b856.slice/crio-c0d47a82dce81b8bed2e95a936a8a9ce511c2f9b4c41e039b074b12ad96a866a WatchSource:0}: Error finding container c0d47a82dce81b8bed2e95a936a8a9ce511c2f9b4c41e039b074b12ad96a866a: Status 404 returned error can't find the container with id c0d47a82dce81b8bed2e95a936a8a9ce511c2f9b4c41e039b074b12ad96a866a
Jul 15 14:41:45.438601 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.438558    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wrb2q"]
Jul 15 14:41:45.443356 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.443336    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wrb2q"
Jul 15 14:41:45.448491 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.448469    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-n7xmn\""
Jul 15 14:41:45.456652 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.456628    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wrb2q"]
Jul 15 14:41:45.475376 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.475340    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:45.521818 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.521768    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz" event={"ID":"2865934b-c991-43c2-a1cb-bc40e357b856","Type":"ContainerStarted","Data":"c0d47a82dce81b8bed2e95a936a8a9ce511c2f9b4c41e039b074b12ad96a866a"}
Jul 15 14:41:45.581070 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.581031    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:45.594259 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.594229    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4mmz\" (UniqueName: \"kubernetes.io/projected/93cefbf0-d6df-4a21-ac9c-a7082316ebb2-kube-api-access-g4mmz\") pod \"authorino-58cd955675-wrb2q\" (UID: \"93cefbf0-d6df-4a21-ac9c-a7082316ebb2\") " pod="kuadrant-system/authorino-58cd955675-wrb2q"
Jul 15 14:41:45.695730 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.695651    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4mmz\" (UniqueName: \"kubernetes.io/projected/93cefbf0-d6df-4a21-ac9c-a7082316ebb2-kube-api-access-g4mmz\") pod \"authorino-58cd955675-wrb2q\" (UID: \"93cefbf0-d6df-4a21-ac9c-a7082316ebb2\") " pod="kuadrant-system/authorino-58cd955675-wrb2q"
Jul 15 14:41:45.720927 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.720901    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4mmz\" (UniqueName: \"kubernetes.io/projected/93cefbf0-d6df-4a21-ac9c-a7082316ebb2-kube-api-access-g4mmz\") pod \"authorino-58cd955675-wrb2q\" (UID: \"93cefbf0-d6df-4a21-ac9c-a7082316ebb2\") " pod="kuadrant-system/authorino-58cd955675-wrb2q"
Jul 15 14:41:45.753095 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.753068    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wrb2q"
Jul 15 14:41:45.897795 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:45.897757    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wrb2q"]
Jul 15 14:41:45.901767 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:41:45.901739    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93cefbf0_d6df_4a21_ac9c_a7082316ebb2.slice/crio-1abc1d62a965a35f437a9773ad74f24110c686304697318c9f2e9edd4bc84e66 WatchSource:0}: Error finding container 1abc1d62a965a35f437a9773ad74f24110c686304697318c9f2e9edd4bc84e66: Status 404 returned error can't find the container with id 1abc1d62a965a35f437a9773ad74f24110c686304697318c9f2e9edd4bc84e66
Jul 15 14:41:46.529493 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:46.529449    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wrb2q" event={"ID":"93cefbf0-d6df-4a21-ac9c-a7082316ebb2","Type":"ContainerStarted","Data":"1abc1d62a965a35f437a9773ad74f24110c686304697318c9f2e9edd4bc84e66"}
Jul 15 14:41:50.532845 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:50.532815    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wrb2q"]
Jul 15 14:41:50.553442 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:50.553404    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz" event={"ID":"2865934b-c991-43c2-a1cb-bc40e357b856","Type":"ContainerStarted","Data":"46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342"}
Jul 15 14:41:50.553609 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:50.553556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:41:50.554797 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:50.554768    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wrb2q" event={"ID":"93cefbf0-d6df-4a21-ac9c-a7082316ebb2","Type":"ContainerStarted","Data":"2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0"}
Jul 15 14:41:50.579324 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:50.579278    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz" podStartSLOduration=1.815675868 podStartE2EDuration="6.579263959s" totalImagesPullingTime="4.763588091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:41:50.577867168 +0000 UTC m=+670.470971533" watchObservedRunningTime="2026-07-15 14:41:50.579263959 +0000 UTC m=+670.472368323"
Jul 15 14:41:50.598324 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:50.598279    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wrb2q" podStartSLOduration=1.580418281 podStartE2EDuration="5.598265136s" totalImagesPullingTime="4.017846855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:41:50.598244067 +0000 UTC m=+670.491348433" watchObservedRunningTime="2026-07-15 14:41:50.598265136 +0000 UTC m=+670.491369501"
Jul 15 14:41:51.559615 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:51.559569    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wrb2q" podUID="93cefbf0-d6df-4a21-ac9c-a7082316ebb2" containerName="authorino" containerID="cri-o://2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0" gracePeriod=30
Jul 15 14:41:51.800203 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:51.800180    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wrb2q"
Jul 15 14:41:51.952729 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:51.952698    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4mmz\" (UniqueName: \"kubernetes.io/projected/93cefbf0-d6df-4a21-ac9c-a7082316ebb2-kube-api-access-g4mmz\") pod \"93cefbf0-d6df-4a21-ac9c-a7082316ebb2\" (UID: \"93cefbf0-d6df-4a21-ac9c-a7082316ebb2\") "
Jul 15 14:41:51.954800 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:51.954776    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93cefbf0-d6df-4a21-ac9c-a7082316ebb2-kube-api-access-g4mmz" (OuterVolumeSpecName: "kube-api-access-g4mmz") pod "93cefbf0-d6df-4a21-ac9c-a7082316ebb2" (UID: "93cefbf0-d6df-4a21-ac9c-a7082316ebb2"). InnerVolumeSpecName "kube-api-access-g4mmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:41:52.053503 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:52.053467    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4mmz\" (UniqueName: \"kubernetes.io/projected/93cefbf0-d6df-4a21-ac9c-a7082316ebb2-kube-api-access-g4mmz\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:41:52.565158 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:52.565105    2574 generic.go:356] "Generic (PLEG): container finished" podID="93cefbf0-d6df-4a21-ac9c-a7082316ebb2" containerID="2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0" exitCode=0
Jul 15 14:41:52.565633 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:52.565166    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wrb2q"
Jul 15 14:41:52.565633 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:52.565187    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wrb2q" event={"ID":"93cefbf0-d6df-4a21-ac9c-a7082316ebb2","Type":"ContainerDied","Data":"2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0"}
Jul 15 14:41:52.565633 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:52.565221    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wrb2q" event={"ID":"93cefbf0-d6df-4a21-ac9c-a7082316ebb2","Type":"ContainerDied","Data":"1abc1d62a965a35f437a9773ad74f24110c686304697318c9f2e9edd4bc84e66"}
Jul 15 14:41:52.565633 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:52.565238    2574 scope.go:117] "RemoveContainer" containerID="2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0"
Jul 15 14:41:52.574634 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:52.574614    2574 scope.go:117] "RemoveContainer" containerID="2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0"
Jul 15 14:41:52.574894 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:41:52.574877    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0\": container with ID starting with 2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0 not found: ID does not exist" containerID="2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0"
Jul 15 14:41:52.574945 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:52.574901    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0"} err="failed to get container status \"2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0\": rpc error: code = NotFound desc = could not find container \"2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0\": container with ID starting with 2ebf758a6acde2ed23805f4a091749e7f3b258f7b51e10dc4f7bbd5bbeb199f0 not found: ID does not exist"
Jul 15 14:41:52.587854 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:52.587829    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wrb2q"]
Jul 15 14:41:52.594711 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:52.594689    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wrb2q"]
Jul 15 14:41:52.652642 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:52.652613    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93cefbf0-d6df-4a21-ac9c-a7082316ebb2" path="/var/lib/kubelet/pods/93cefbf0-d6df-4a21-ac9c-a7082316ebb2/volumes"
Jul 15 14:41:59.510068 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:59.510035    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"]
Jul 15 14:41:59.510591 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:59.510220    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz" podUID="2865934b-c991-43c2-a1cb-bc40e357b856" containerName="limitador" containerID="cri-o://46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342" gracePeriod=30
Jul 15 14:41:59.510955 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:41:59.510919    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:42:00.065547 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.065519    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:42:00.219600 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.219565    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwt46\" (UniqueName: \"kubernetes.io/projected/2865934b-c991-43c2-a1cb-bc40e357b856-kube-api-access-wwt46\") pod \"2865934b-c991-43c2-a1cb-bc40e357b856\" (UID: \"2865934b-c991-43c2-a1cb-bc40e357b856\") "
Jul 15 14:42:00.219784 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.219657    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2865934b-c991-43c2-a1cb-bc40e357b856-config-file\") pod \"2865934b-c991-43c2-a1cb-bc40e357b856\" (UID: \"2865934b-c991-43c2-a1cb-bc40e357b856\") "
Jul 15 14:42:00.220010 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.219983    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2865934b-c991-43c2-a1cb-bc40e357b856-config-file" (OuterVolumeSpecName: "config-file") pod "2865934b-c991-43c2-a1cb-bc40e357b856" (UID: "2865934b-c991-43c2-a1cb-bc40e357b856"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:42:00.221743 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.221725    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2865934b-c991-43c2-a1cb-bc40e357b856-kube-api-access-wwt46" (OuterVolumeSpecName: "kube-api-access-wwt46") pod "2865934b-c991-43c2-a1cb-bc40e357b856" (UID: "2865934b-c991-43c2-a1cb-bc40e357b856"). InnerVolumeSpecName "kube-api-access-wwt46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:42:00.320831 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.320793    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2865934b-c991-43c2-a1cb-bc40e357b856-config-file\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:42:00.320831 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.320825    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwt46\" (UniqueName: \"kubernetes.io/projected/2865934b-c991-43c2-a1cb-bc40e357b856-kube-api-access-wwt46\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:42:00.605025 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.604935    2574 generic.go:356] "Generic (PLEG): container finished" podID="2865934b-c991-43c2-a1cb-bc40e357b856" containerID="46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342" exitCode=0
Jul 15 14:42:00.605025 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.604982    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"
Jul 15 14:42:00.605504 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.605031    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz" event={"ID":"2865934b-c991-43c2-a1cb-bc40e357b856","Type":"ContainerDied","Data":"46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342"}
Jul 15 14:42:00.605504 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.605083    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-bb5dz" event={"ID":"2865934b-c991-43c2-a1cb-bc40e357b856","Type":"ContainerDied","Data":"c0d47a82dce81b8bed2e95a936a8a9ce511c2f9b4c41e039b074b12ad96a866a"}
Jul 15 14:42:00.605504 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.605107    2574 scope.go:117] "RemoveContainer" containerID="46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342"
Jul 15 14:42:00.613987 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.613964    2574 scope.go:117] "RemoveContainer" containerID="46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342"
Jul 15 14:42:00.614297 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:42:00.614279    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342\": container with ID starting with 46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342 not found: ID does not exist" containerID="46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342"
Jul 15 14:42:00.614357 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.614308    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342"} err="failed to get container status \"46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342\": rpc error: code = NotFound desc = could not find container \"46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342\": container with ID starting with 46670d3603d444bd71fc046316c8363da793ec4a10db5634ddc9606bff23d342 not found: ID does not exist"
Jul 15 14:42:00.627996 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.627966    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"]
Jul 15 14:42:00.630358 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.630335    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-bb5dz"]
Jul 15 14:42:00.652566 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.652537    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2865934b-c991-43c2-a1cb-bc40e357b856" path="/var/lib/kubelet/pods/2865934b-c991-43c2-a1cb-bc40e357b856/volumes"
Jul 15 14:42:00.765972 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.765937    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:00.867531 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:00.867443    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:01.368008 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.367971    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"]
Jul 15 14:42:01.368404 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.368390    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93cefbf0-d6df-4a21-ac9c-a7082316ebb2" containerName="authorino"
Jul 15 14:42:01.368470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.368405    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="93cefbf0-d6df-4a21-ac9c-a7082316ebb2" containerName="authorino"
Jul 15 14:42:01.368470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.368416    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2865934b-c991-43c2-a1cb-bc40e357b856" containerName="limitador"
Jul 15 14:42:01.368470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.368433    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2865934b-c991-43c2-a1cb-bc40e357b856" containerName="limitador"
Jul 15 14:42:01.368603 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.368489    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2865934b-c991-43c2-a1cb-bc40e357b856" containerName="limitador"
Jul 15 14:42:01.368603 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.368498    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="93cefbf0-d6df-4a21-ac9c-a7082316ebb2" containerName="authorino"
Jul 15 14:42:01.372712 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.372691    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"
Jul 15 14:42:01.377252 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.377230    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 14:42:01.377511 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.377492    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-n75rr\""
Jul 15 14:42:01.380393 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.380377    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 14:42:01.388402 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.388386    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 14:42:01.412970 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.412932    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"]
Jul 15 14:42:01.414566 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.414535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:01.534895 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.534858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxzk2\" (UniqueName: \"kubernetes.io/projected/49671303-97c9-407c-8d23-b23ccd14ee40-kube-api-access-jxzk2\") pod \"postgres-69fb4594cf-jxm5v\" (UID: \"49671303-97c9-407c-8d23-b23ccd14ee40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"
Jul 15 14:42:01.535081 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.534921    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/49671303-97c9-407c-8d23-b23ccd14ee40-data\") pod \"postgres-69fb4594cf-jxm5v\" (UID: \"49671303-97c9-407c-8d23-b23ccd14ee40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"
Jul 15 14:42:01.636400 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.636314    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxzk2\" (UniqueName: \"kubernetes.io/projected/49671303-97c9-407c-8d23-b23ccd14ee40-kube-api-access-jxzk2\") pod \"postgres-69fb4594cf-jxm5v\" (UID: \"49671303-97c9-407c-8d23-b23ccd14ee40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"
Jul 15 14:42:01.636400 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.636376    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/49671303-97c9-407c-8d23-b23ccd14ee40-data\") pod \"postgres-69fb4594cf-jxm5v\" (UID: \"49671303-97c9-407c-8d23-b23ccd14ee40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"
Jul 15 14:42:01.636780 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.636704    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/49671303-97c9-407c-8d23-b23ccd14ee40-data\") pod \"postgres-69fb4594cf-jxm5v\" (UID: \"49671303-97c9-407c-8d23-b23ccd14ee40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"
Jul 15 14:42:01.646108 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.646084    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxzk2\" (UniqueName: \"kubernetes.io/projected/49671303-97c9-407c-8d23-b23ccd14ee40-kube-api-access-jxzk2\") pod \"postgres-69fb4594cf-jxm5v\" (UID: \"49671303-97c9-407c-8d23-b23ccd14ee40\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"
Jul 15 14:42:01.682732 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.682702    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"
Jul 15 14:42:01.815241 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:01.815216    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"]
Jul 15 14:42:01.817754 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:42:01.817725    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49671303_97c9_407c_8d23_b23ccd14ee40.slice/crio-22e8253e03990b9d700a0a940c3a603a2c6b5bd2ca428d3ee31d0dc0a84b90fc WatchSource:0}: Error finding container 22e8253e03990b9d700a0a940c3a603a2c6b5bd2ca428d3ee31d0dc0a84b90fc: Status 404 returned error can't find the container with id 22e8253e03990b9d700a0a940c3a603a2c6b5bd2ca428d3ee31d0dc0a84b90fc
Jul 15 14:42:02.620210 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:02.620165    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v" event={"ID":"49671303-97c9-407c-8d23-b23ccd14ee40","Type":"ContainerStarted","Data":"22e8253e03990b9d700a0a940c3a603a2c6b5bd2ca428d3ee31d0dc0a84b90fc"}
Jul 15 14:42:07.650061 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:07.650031    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v" event={"ID":"49671303-97c9-407c-8d23-b23ccd14ee40","Type":"ContainerStarted","Data":"9c16b3cd3aae7cd487ca5096a8e1b73d0cab7aedc9cc7192e1bb84c4a8f62644"}
Jul 15 14:42:07.650578 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:07.650078    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"
Jul 15 14:42:07.673985 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:07.673940    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v" podStartSLOduration=1.328011918 podStartE2EDuration="6.673926241s" totalImagesPullingTime="5.345914323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:42:07.670467895 +0000 UTC m=+687.563572260" watchObservedRunningTime="2026-07-15 14:42:07.673926241 +0000 UTC m=+687.567030607"
Jul 15 14:42:13.683864 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:13.683835    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-jxm5v"
Jul 15 14:42:14.052356 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:14.052266    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:14.358287 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:14.358190    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:21.508265 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.508214    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:21.532644 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.532616    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bc4685f69-9skkm"]
Jul 15 14:42:21.670038 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.670008    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:21.724054 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.724019    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bc4685f69-9skkm"]
Jul 15 14:42:21.724271 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.724165    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:21.727296 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.727278    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 14:42:21.727428 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.727388    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 14:42:21.728368 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.728335    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g6zv2\""
Jul 15 14:42:21.757287 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.757258    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5498759d79-b8p9f"]
Jul 15 14:42:21.765990 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.765931    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:21.788879 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.788853    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5498759d79-b8p9f"]
Jul 15 14:42:21.789003 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.788943    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:42:21.805377 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.805357    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psnv6\" (UniqueName: \"kubernetes.io/projected/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-kube-api-access-psnv6\") pod \"maas-controller-7bc4685f69-9skkm\" (UID: \"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0\") " pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:21.805470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.805390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ee9bc84-ef76-405c-8699-2fd9a7461c34-webhook-cert\") pod \"maas-controller-5498759d79-b8p9f\" (UID: \"5ee9bc84-ef76-405c-8699-2fd9a7461c34\") " pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:42:21.805470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.805430    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69mf6\" (UniqueName: \"kubernetes.io/projected/5ee9bc84-ef76-405c-8699-2fd9a7461c34-kube-api-access-69mf6\") pod \"maas-controller-5498759d79-b8p9f\" (UID: \"5ee9bc84-ef76-405c-8699-2fd9a7461c34\") " pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:42:21.805470 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.805465    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-webhook-cert\") pod \"maas-controller-7bc4685f69-9skkm\" (UID: \"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0\") " pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:21.906376 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.906321    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-webhook-cert\") pod \"maas-controller-7bc4685f69-9skkm\" (UID: \"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0\") " pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:21.906575 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.906391    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psnv6\" (UniqueName: \"kubernetes.io/projected/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-kube-api-access-psnv6\") pod \"maas-controller-7bc4685f69-9skkm\" (UID: \"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0\") " pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:21.906575 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.906423    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ee9bc84-ef76-405c-8699-2fd9a7461c34-webhook-cert\") pod \"maas-controller-5498759d79-b8p9f\" (UID: \"5ee9bc84-ef76-405c-8699-2fd9a7461c34\") " pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:42:21.906575 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.906458    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69mf6\" (UniqueName: \"kubernetes.io/projected/5ee9bc84-ef76-405c-8699-2fd9a7461c34-kube-api-access-69mf6\") pod \"maas-controller-5498759d79-b8p9f\" (UID: \"5ee9bc84-ef76-405c-8699-2fd9a7461c34\") " pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:42:21.908859 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.908832    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ee9bc84-ef76-405c-8699-2fd9a7461c34-webhook-cert\") pod \"maas-controller-5498759d79-b8p9f\" (UID: \"5ee9bc84-ef76-405c-8699-2fd9a7461c34\") " pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:42:21.908964 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.908833    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-webhook-cert\") pod \"maas-controller-7bc4685f69-9skkm\" (UID: \"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0\") " pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:21.915600 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.915570    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69mf6\" (UniqueName: \"kubernetes.io/projected/5ee9bc84-ef76-405c-8699-2fd9a7461c34-kube-api-access-69mf6\") pod \"maas-controller-5498759d79-b8p9f\" (UID: \"5ee9bc84-ef76-405c-8699-2fd9a7461c34\") " pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:42:21.915976 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:21.915959    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psnv6\" (UniqueName: \"kubernetes.io/projected/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-kube-api-access-psnv6\") pod \"maas-controller-7bc4685f69-9skkm\" (UID: \"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0\") " pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:22.035332 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:22.035255    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:22.098519 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:22.098489    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:42:22.213701 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:22.213669    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bc4685f69-9skkm"]
Jul 15 14:42:22.215915 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:42:22.215885    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod409f19b1_c0f9_4d8a_9520_0c9b0b19f5b0.slice/crio-00662a37acc88844d8cf7c1fd4993ca0009420722592cefc82f11c53bf751283 WatchSource:0}: Error finding container 00662a37acc88844d8cf7c1fd4993ca0009420722592cefc82f11c53bf751283: Status 404 returned error can't find the container with id 00662a37acc88844d8cf7c1fd4993ca0009420722592cefc82f11c53bf751283
Jul 15 14:42:22.269581 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:22.269482    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5498759d79-b8p9f"]
Jul 15 14:42:22.272118 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:42:22.272095    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee9bc84_ef76_405c_8699_2fd9a7461c34.slice/crio-7aecf533043381cdc6bfb6dd8fc9005f83055d4812e8bfc9587ba6cbc9457afc WatchSource:0}: Error finding container 7aecf533043381cdc6bfb6dd8fc9005f83055d4812e8bfc9587ba6cbc9457afc: Status 404 returned error can't find the container with id 7aecf533043381cdc6bfb6dd8fc9005f83055d4812e8bfc9587ba6cbc9457afc
Jul 15 14:42:22.718219 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:22.718182    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5498759d79-b8p9f" event={"ID":"5ee9bc84-ef76-405c-8699-2fd9a7461c34","Type":"ContainerStarted","Data":"7aecf533043381cdc6bfb6dd8fc9005f83055d4812e8bfc9587ba6cbc9457afc"}
Jul 15 14:42:22.719346 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:22.719323    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc4685f69-9skkm" event={"ID":"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0","Type":"ContainerStarted","Data":"00662a37acc88844d8cf7c1fd4993ca0009420722592cefc82f11c53bf751283"}
Jul 15 14:42:25.180497 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:25.180448    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:25.279297 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:25.279210    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:25.744335 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:25.744300    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5498759d79-b8p9f" event={"ID":"5ee9bc84-ef76-405c-8699-2fd9a7461c34","Type":"ContainerStarted","Data":"6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31"}
Jul 15 14:42:25.744549 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:25.744400    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:42:25.745848 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:25.745825    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc4685f69-9skkm" event={"ID":"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0","Type":"ContainerStarted","Data":"2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35"}
Jul 15 14:42:25.745944 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:25.745879    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:25.804027 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:25.803978    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5498759d79-b8p9f" podStartSLOduration=2.11057412 podStartE2EDuration="4.803963287s" totalImagesPullingTime="2.693389167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:42:25.802660526 +0000 UTC m=+705.695764892" watchObservedRunningTime="2026-07-15 14:42:25.803963287 +0000 UTC m=+705.697067653"
Jul 15 14:42:25.845843 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:25.845788    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bc4685f69-9skkm" podStartSLOduration=2.085234282 podStartE2EDuration="4.845768637s" totalImagesPullingTime="2.760534355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:42:25.844412779 +0000 UTC m=+705.737517145" watchObservedRunningTime="2026-07-15 14:42:25.845768637 +0000 UTC m=+705.738873004"
Jul 15 14:42:32.777832 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:32.777751    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:36.754348 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:36.754320    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:36.754751 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:36.754438    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:42:36.823618 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:36.823585    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bc4685f69-9skkm"]
Jul 15 14:42:36.823846 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:36.823813    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bc4685f69-9skkm" podUID="409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0" containerName="manager" containerID="cri-o://2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35" gracePeriod=30
Jul 15 14:42:37.076763 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.076737    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:37.144343 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.144313    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-webhook-cert\") pod \"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0\" (UID: \"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0\") "
Jul 15 14:42:37.144507 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.144408    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psnv6\" (UniqueName: \"kubernetes.io/projected/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-kube-api-access-psnv6\") pod \"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0\" (UID: \"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0\") "
Jul 15 14:42:37.146553 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.146524    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-kube-api-access-psnv6" (OuterVolumeSpecName: "kube-api-access-psnv6") pod "409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0" (UID: "409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0"). InnerVolumeSpecName "kube-api-access-psnv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:42:37.146553 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.146524    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0" (UID: "409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:42:37.245491 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.245458    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psnv6\" (UniqueName: \"kubernetes.io/projected/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-kube-api-access-psnv6\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:42:37.245491 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.245486    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0-webhook-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:42:37.804304 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.804264    2574 generic.go:356] "Generic (PLEG): container finished" podID="409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0" containerID="2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35" exitCode=0
Jul 15 14:42:37.804754 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.804311    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bc4685f69-9skkm"
Jul 15 14:42:37.804754 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.804350    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc4685f69-9skkm" event={"ID":"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0","Type":"ContainerDied","Data":"2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35"}
Jul 15 14:42:37.804754 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.804399    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bc4685f69-9skkm" event={"ID":"409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0","Type":"ContainerDied","Data":"00662a37acc88844d8cf7c1fd4993ca0009420722592cefc82f11c53bf751283"}
Jul 15 14:42:37.804754 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.804425    2574 scope.go:117] "RemoveContainer" containerID="2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35"
Jul 15 14:42:37.813525 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.813506    2574 scope.go:117] "RemoveContainer" containerID="2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35"
Jul 15 14:42:37.813776 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:42:37.813760    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35\": container with ID starting with 2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35 not found: ID does not exist" containerID="2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35"
Jul 15 14:42:37.813827 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.813786    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35"} err="failed to get container status \"2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35\": rpc error: code = NotFound desc = could not find container \"2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35\": container with ID starting with 2878534212f1931b15b9842fafb3df5e6549d9a8e2f530f20ca66f592f970d35 not found: ID does not exist"
Jul 15 14:42:37.826815 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.826791    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bc4685f69-9skkm"]
Jul 15 14:42:37.830083 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:37.830064    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bc4685f69-9skkm"]
Jul 15 14:42:38.653016 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:38.652982    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0" path="/var/lib/kubelet/pods/409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0/volumes"
Jul 15 14:42:57.190366 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:57.190323    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:57.385251 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:57.385221    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:57.696449 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:57.696420    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:57.840356 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:57.840327    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"]
Jul 15 14:42:57.840762 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:57.840745    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0" containerName="manager"
Jul 15 14:42:57.840850 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:57.840765    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0" containerName="manager"
Jul 15 14:42:57.840909 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:57.840880    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="409f19b1-c0f9-4d8a-9520-0c9b0b19f5b0" containerName="manager"
Jul 15 14:42:57.848777 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:57.848751    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:57.851844 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:57.851819    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 14:42:57.851978 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:57.851949    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfwqq\""
Jul 15 14:42:57.859225 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:57.859203    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"]
Jul 15 14:42:58.030719 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.030627    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e614bf1a-209b-432d-864b-df6c76921d35-openshift-service-ca\") pod \"maas-api-76cddc5c78-nbb56\" (UID: \"e614bf1a-209b-432d-864b-df6c76921d35\") " pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:58.030719 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.030666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e614bf1a-209b-432d-864b-df6c76921d35-maas-api-tls\") pod \"maas-api-76cddc5c78-nbb56\" (UID: \"e614bf1a-209b-432d-864b-df6c76921d35\") " pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:58.030926 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.030805    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkvpq\" (UniqueName: \"kubernetes.io/projected/e614bf1a-209b-432d-864b-df6c76921d35-kube-api-access-kkvpq\") pod \"maas-api-76cddc5c78-nbb56\" (UID: \"e614bf1a-209b-432d-864b-df6c76921d35\") " pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:58.131819 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.131779    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e614bf1a-209b-432d-864b-df6c76921d35-openshift-service-ca\") pod \"maas-api-76cddc5c78-nbb56\" (UID: \"e614bf1a-209b-432d-864b-df6c76921d35\") " pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:58.131819 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.131818    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e614bf1a-209b-432d-864b-df6c76921d35-maas-api-tls\") pod \"maas-api-76cddc5c78-nbb56\" (UID: \"e614bf1a-209b-432d-864b-df6c76921d35\") " pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:58.132021 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.131885    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkvpq\" (UniqueName: \"kubernetes.io/projected/e614bf1a-209b-432d-864b-df6c76921d35-kube-api-access-kkvpq\") pod \"maas-api-76cddc5c78-nbb56\" (UID: \"e614bf1a-209b-432d-864b-df6c76921d35\") " pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:58.132021 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:42:58.132011    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 15 14:42:58.132097 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:42:58.132086    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e614bf1a-209b-432d-864b-df6c76921d35-maas-api-tls podName:e614bf1a-209b-432d-864b-df6c76921d35 nodeName:}" failed. No retries permitted until 2026-07-15 14:42:58.632067015 +0000 UTC m=+738.525171376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e614bf1a-209b-432d-864b-df6c76921d35-maas-api-tls") pod "maas-api-76cddc5c78-nbb56" (UID: "e614bf1a-209b-432d-864b-df6c76921d35") : secret "maas-api-serving-cert" not found
Jul 15 14:42:58.132422 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.132402    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e614bf1a-209b-432d-864b-df6c76921d35-openshift-service-ca\") pod \"maas-api-76cddc5c78-nbb56\" (UID: \"e614bf1a-209b-432d-864b-df6c76921d35\") " pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:58.149614 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.149577    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkvpq\" (UniqueName: \"kubernetes.io/projected/e614bf1a-209b-432d-864b-df6c76921d35-kube-api-access-kkvpq\") pod \"maas-api-76cddc5c78-nbb56\" (UID: \"e614bf1a-209b-432d-864b-df6c76921d35\") " pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:58.383688 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.383587    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:58.517655 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.517614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:58.579959 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.579920    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"]
Jul 15 14:42:58.584019 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.583992    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"
Jul 15 14:42:58.589458 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.589437    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 14:42:58.600657 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.600632    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"]
Jul 15 14:42:58.633527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.633495    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"]
Jul 15 14:42:58.635788 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.635722    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e614bf1a-209b-432d-864b-df6c76921d35-maas-api-tls\") pod \"maas-api-76cddc5c78-nbb56\" (UID: \"e614bf1a-209b-432d-864b-df6c76921d35\") " pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:58.637597 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.637577    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"
Jul 15 14:42:58.638348 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.638325    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e614bf1a-209b-432d-864b-df6c76921d35-maas-api-tls\") pod \"maas-api-76cddc5c78-nbb56\" (UID: \"e614bf1a-209b-432d-864b-df6c76921d35\") " pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:58.642900 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.642878    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-75q2j\""
Jul 15 14:42:58.650693 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.650662    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:58.653482 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.653463    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"]
Jul 15 14:42:58.736873 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.736841    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/858ea7db-2970-4fc9-a576-7974b109c861-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-k64zx\" (UID: \"858ea7db-2970-4fc9-a576-7974b109c861\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"
Jul 15 14:42:58.737075 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.736889    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1436812e-8a9b-4cc4-9d06-ee008de22677-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-fvhdw\" (UID: \"1436812e-8a9b-4cc4-9d06-ee008de22677\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"
Jul 15 14:42:58.737075 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.736911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hnsl\" (UniqueName: \"kubernetes.io/projected/858ea7db-2970-4fc9-a576-7974b109c861-kube-api-access-9hnsl\") pod \"payload-pre-processing-74584bb9f8-k64zx\" (UID: \"858ea7db-2970-4fc9-a576-7974b109c861\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"
Jul 15 14:42:58.737075 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.737022    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s96n5\" (UniqueName: \"kubernetes.io/projected/1436812e-8a9b-4cc4-9d06-ee008de22677-kube-api-access-s96n5\") pod \"payload-processing-f9b8d9b9b-fvhdw\" (UID: \"1436812e-8a9b-4cc4-9d06-ee008de22677\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"
Jul 15 14:42:58.759785 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.759744    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:42:58.838437 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.838237    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1436812e-8a9b-4cc4-9d06-ee008de22677-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-fvhdw\" (UID: \"1436812e-8a9b-4cc4-9d06-ee008de22677\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"
Jul 15 14:42:58.838437 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.838290    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hnsl\" (UniqueName: \"kubernetes.io/projected/858ea7db-2970-4fc9-a576-7974b109c861-kube-api-access-9hnsl\") pod \"payload-pre-processing-74584bb9f8-k64zx\" (UID: \"858ea7db-2970-4fc9-a576-7974b109c861\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"
Jul 15 14:42:58.838437 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.838356    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s96n5\" (UniqueName: \"kubernetes.io/projected/1436812e-8a9b-4cc4-9d06-ee008de22677-kube-api-access-s96n5\") pod \"payload-processing-f9b8d9b9b-fvhdw\" (UID: \"1436812e-8a9b-4cc4-9d06-ee008de22677\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"
Jul 15 14:42:58.838437 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.838441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/858ea7db-2970-4fc9-a576-7974b109c861-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-k64zx\" (UID: \"858ea7db-2970-4fc9-a576-7974b109c861\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"
Jul 15 14:42:58.839434 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.839406    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/858ea7db-2970-4fc9-a576-7974b109c861-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-k64zx\" (UID: \"858ea7db-2970-4fc9-a576-7974b109c861\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"
Jul 15 14:42:58.839573 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.839409    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1436812e-8a9b-4cc4-9d06-ee008de22677-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-fvhdw\" (UID: \"1436812e-8a9b-4cc4-9d06-ee008de22677\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"
Jul 15 14:42:58.854762 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.854727    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hnsl\" (UniqueName: \"kubernetes.io/projected/858ea7db-2970-4fc9-a576-7974b109c861-kube-api-access-9hnsl\") pod \"payload-pre-processing-74584bb9f8-k64zx\" (UID: \"858ea7db-2970-4fc9-a576-7974b109c861\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"
Jul 15 14:42:58.855343 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.855322    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s96n5\" (UniqueName: \"kubernetes.io/projected/1436812e-8a9b-4cc4-9d06-ee008de22677-kube-api-access-s96n5\") pod \"payload-processing-f9b8d9b9b-fvhdw\" (UID: \"1436812e-8a9b-4cc4-9d06-ee008de22677\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"
Jul 15 14:42:58.895001 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.894927    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"
Jul 15 14:42:58.923086 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.923058    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"]
Jul 15 14:42:58.925036 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:42:58.925008    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode614bf1a_209b_432d_864b_df6c76921d35.slice/crio-626b39521cb09537dd519f841d19d63b47dc58ae28156236d22030705eb3e3cb WatchSource:0}: Error finding container 626b39521cb09537dd519f841d19d63b47dc58ae28156236d22030705eb3e3cb: Status 404 returned error can't find the container with id 626b39521cb09537dd519f841d19d63b47dc58ae28156236d22030705eb3e3cb
Jul 15 14:42:58.926424 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.926407    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:42:58.958486 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:58.958460    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"
Jul 15 14:42:59.044006 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:59.043983    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"]
Jul 15 14:42:59.046221 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:42:59.046194    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1436812e_8a9b_4cc4_9d06_ee008de22677.slice/crio-3e74e49810c376411b31c3181369e4ca16853e1673255fe09e8ab4ab2ba4c402 WatchSource:0}: Error finding container 3e74e49810c376411b31c3181369e4ca16853e1673255fe09e8ab4ab2ba4c402: Status 404 returned error can't find the container with id 3e74e49810c376411b31c3181369e4ca16853e1673255fe09e8ab4ab2ba4c402
Jul 15 14:42:59.108073 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:59.108048    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"]
Jul 15 14:42:59.110171 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:42:59.110109    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858ea7db_2970_4fc9_a576_7974b109c861.slice/crio-dd5109b1e36762f57fc2b1900d2e98e1013d113016e602f840af73aa1b4bab25 WatchSource:0}: Error finding container dd5109b1e36762f57fc2b1900d2e98e1013d113016e602f840af73aa1b4bab25: Status 404 returned error can't find the container with id dd5109b1e36762f57fc2b1900d2e98e1013d113016e602f840af73aa1b4bab25
Jul 15 14:42:59.914362 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:59.914237    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx" event={"ID":"858ea7db-2970-4fc9-a576-7974b109c861","Type":"ContainerStarted","Data":"dd5109b1e36762f57fc2b1900d2e98e1013d113016e602f840af73aa1b4bab25"}
Jul 15 14:42:59.917986 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:59.917953    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56" event={"ID":"e614bf1a-209b-432d-864b-df6c76921d35","Type":"ContainerStarted","Data":"626b39521cb09537dd519f841d19d63b47dc58ae28156236d22030705eb3e3cb"}
Jul 15 14:42:59.920630 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:42:59.920564    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw" event={"ID":"1436812e-8a9b-4cc4-9d06-ee008de22677","Type":"ContainerStarted","Data":"3e74e49810c376411b31c3181369e4ca16853e1673255fe09e8ab4ab2ba4c402"}
Jul 15 14:43:00.927806 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:00.927769    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx" event={"ID":"858ea7db-2970-4fc9-a576-7974b109c861","Type":"ContainerStarted","Data":"d0db3d2ca52417eeb508fe6d5ca8f8d2d0c98996187adddbad978d8699a21f78"}
Jul 15 14:43:00.928245 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:00.927859    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"
Jul 15 14:43:00.929435 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:00.929412    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56" event={"ID":"e614bf1a-209b-432d-864b-df6c76921d35","Type":"ContainerStarted","Data":"b54a3612f8faf311b9756de232d65069918109daa71437bee750fced1d54d678"}
Jul 15 14:43:00.929739 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:00.929457    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:43:00.930997 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:00.930979    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw" event={"ID":"1436812e-8a9b-4cc4-9d06-ee008de22677","Type":"ContainerStarted","Data":"4ba367dac743ad9bdd3b4e7d23ae6228b6b577276350c47d0c9ef765de6c487e"}
Jul 15 14:43:00.931075 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:00.931031    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"
Jul 15 14:43:00.950456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:00.950391    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx" podStartSLOduration=1.257778553 podStartE2EDuration="2.950370784s" totalImagesPullingTime="1.692592231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:43:00.950168961 +0000 UTC m=+740.843273340" watchObservedRunningTime="2026-07-15 14:43:00.950370784 +0000 UTC m=+740.843475144"
Jul 15 14:43:00.972934 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:00.972870    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw" podStartSLOduration=1.218909275 podStartE2EDuration="2.972848989s" totalImagesPullingTime="1.753939714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:43:00.972517661 +0000 UTC m=+740.865622026" watchObservedRunningTime="2026-07-15 14:43:00.972848989 +0000 UTC m=+740.865953355"
Jul 15 14:43:01.000792 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:01.000746    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56" podStartSLOduration=2.125041128 podStartE2EDuration="4.000730476s" totalImagesPullingTime="1.875689348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:43:00.999464959 +0000 UTC m=+740.892569325" watchObservedRunningTime="2026-07-15 14:43:01.000730476 +0000 UTC m=+740.893834840"
Jul 15 14:43:06.942228 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:06.942198    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-76cddc5c78-nbb56"
Jul 15 14:43:08.764884 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:08.764845    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:08.901199 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:08.901160    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:11.939004 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:11.938964    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-fvhdw"
Jul 15 14:43:11.939488 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:11.939253    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-k64zx"
Jul 15 14:43:21.745781 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.745743    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"]
Jul 15 14:43:21.749467 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.749450    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.754309 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.754288    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 14:43:21.755410 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.755389    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 14:43:21.755562 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.755545    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jhjp2\""
Jul 15 14:43:21.755562 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.755560    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 14:43:21.766299 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.766272    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"]
Jul 15 14:43:21.827737 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.827695    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:21.844862 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.844825    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.844862 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.844864    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.845086 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.844882    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j85g4\" (UniqueName: \"kubernetes.io/projected/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-kube-api-access-j85g4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.845086 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.844995    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.845086 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.845040    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.845259 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.845090    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.946428 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.946396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.946583 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.946442    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.946583 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.946533    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j85g4\" (UniqueName: \"kubernetes.io/projected/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-kube-api-access-j85g4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.946689 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.946583    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.946689 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.946604    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.946689 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.946635    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.946846 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.946826    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.946966 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.946942    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.947042 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.947025    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.948866 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.948840    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.948982 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.948945    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:21.956007 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:21.955982    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j85g4\" (UniqueName: \"kubernetes.io/projected/61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34-kube-api-access-j85g4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59\" (UID: \"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:22.060047 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:22.059940    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:22.211826 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:22.211804    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"]
Jul 15 14:43:22.214233 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:43:22.214204    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61bf7bcd_fd60_4446_8cf6_9bb06a5ddf34.slice/crio-c0cf8d8afe9bd6b68c5e4c32390e721c0aeb406f7a43f39aabe23d466d15bf76 WatchSource:0}: Error finding container c0cf8d8afe9bd6b68c5e4c32390e721c0aeb406f7a43f39aabe23d466d15bf76: Status 404 returned error can't find the container with id c0cf8d8afe9bd6b68c5e4c32390e721c0aeb406f7a43f39aabe23d466d15bf76
Jul 15 14:43:23.041332 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:23.041299    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59" event={"ID":"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34","Type":"ContainerStarted","Data":"c0cf8d8afe9bd6b68c5e4c32390e721c0aeb406f7a43f39aabe23d466d15bf76"}
Jul 15 14:43:24.048241 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:24.048204    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59" event={"ID":"61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34","Type":"ContainerStarted","Data":"f4e8aaabfdf0b01e9a89611091c6f01422f975fd717a2cd4ef2b7b32af4f5ea1"}
Jul 15 14:43:24.070788 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:24.070731    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59" podStartSLOduration=1.869831056 podStartE2EDuration="3.070714796s" totalImagesPullingTime="1.20088374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:43:24.068690699 +0000 UTC m=+763.961795064" watchObservedRunningTime="2026-07-15 14:43:24.070714796 +0000 UTC m=+763.963819207"
Jul 15 14:43:32.061200 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:32.061147    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:32.061605 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:32.061229    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:32.073623 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:32.073594    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:32.098855 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:32.098829    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59"
Jul 15 14:43:47.994212 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:47.994168    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:52.010032 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.010002    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"]
Jul 15 14:43:52.013664 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.013647    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.017910 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.017880    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 14:43:52.039099 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.039062    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"]
Jul 15 14:43:52.080269 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.080240    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:52.114103 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.114073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.114103 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.114103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.114301 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.114127    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.114301 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.114246    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzhmt\" (UniqueName: \"kubernetes.io/projected/6196eb00-9560-4d13-9dab-873290487630-kube-api-access-tzhmt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.114301 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.114296    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6196eb00-9560-4d13-9dab-873290487630-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.114414 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.114337    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.215667 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.215631    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzhmt\" (UniqueName: \"kubernetes.io/projected/6196eb00-9560-4d13-9dab-873290487630-kube-api-access-tzhmt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.215847 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.215699    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6196eb00-9560-4d13-9dab-873290487630-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.215847 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.215739    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.215847 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.215808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.215847 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.215829    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.216070 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.215856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.216307 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.216272    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.216405 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.216310    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.216405 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.216360    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.218046 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.218028    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6196eb00-9560-4d13-9dab-873290487630-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.218244 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.218229    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6196eb00-9560-4d13-9dab-873290487630-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.226653 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.226628    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzhmt\" (UniqueName: \"kubernetes.io/projected/6196eb00-9560-4d13-9dab-873290487630-kube-api-access-tzhmt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6wsj2\" (UID: \"6196eb00-9560-4d13-9dab-873290487630\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.324696 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.324620    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:43:52.469815 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:52.469788    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"]
Jul 15 14:43:52.470732 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:43:52.470702    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6196eb00_9560_4d13_9dab_873290487630.slice/crio-50b5d91e4509d77727db712304cc52dfc9206e2e203eef30b1ff309525f49b78 WatchSource:0}: Error finding container 50b5d91e4509d77727db712304cc52dfc9206e2e203eef30b1ff309525f49b78: Status 404 returned error can't find the container with id 50b5d91e4509d77727db712304cc52dfc9206e2e203eef30b1ff309525f49b78
Jul 15 14:43:53.192831 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:53.192791    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2" event={"ID":"6196eb00-9560-4d13-9dab-873290487630","Type":"ContainerStarted","Data":"e6c49afdd11b94b454eb6ceb8c597bbb2281856e0b1dfaa3fe5eaa979c9bdddf"}
Jul 15 14:43:53.193443 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:53.192855    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2" event={"ID":"6196eb00-9560-4d13-9dab-873290487630","Type":"ContainerStarted","Data":"50b5d91e4509d77727db712304cc52dfc9206e2e203eef30b1ff309525f49b78"}
Jul 15 14:43:53.217440 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:43:53.217389    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2" podStartSLOduration=2.007454358 podStartE2EDuration="2.217371803s" totalImagesPullingTime="209.917445ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:43:53.216493314 +0000 UTC m=+793.109597679" watchObservedRunningTime="2026-07-15 14:43:53.217371803 +0000 UTC m=+793.110476169"
Jul 15 14:44:02.325424 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:02.325323    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:44:02.325424 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:02.325390    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:44:02.337949 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:02.337917    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:44:03.253847 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:03.253820    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6wsj2"
Jul 15 14:44:16.962953 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:16.962914    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:28.906520 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:28.906488    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:37.117898 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.117861    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"]
Jul 15 14:44:37.121399 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.121383    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.125830 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.125809    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 14:44:37.137016 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.136990    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"]
Jul 15 14:44:37.209636 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.209597    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b0d86c-8804-414e-9d46-0eedb63d011c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.209803 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.209653    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.209803 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.209675    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.209803 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.209706    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.209803 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.209787    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.209943 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.209829    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxx5t\" (UniqueName: \"kubernetes.io/projected/44b0d86c-8804-414e-9d46-0eedb63d011c-kube-api-access-fxx5t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.213575 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.213542    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:37.310817 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.310782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.310817 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.310817    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxx5t\" (UniqueName: \"kubernetes.io/projected/44b0d86c-8804-414e-9d46-0eedb63d011c-kube-api-access-fxx5t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.311064 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.310844    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b0d86c-8804-414e-9d46-0eedb63d011c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.311064 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.310871    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.311064 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.310890    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.311064 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.310922    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.311302 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.311237    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.311302 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.311288    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.311400 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.311316    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.313190 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.313153    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44b0d86c-8804-414e-9d46-0eedb63d011c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.313587 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.313564    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44b0d86c-8804-414e-9d46-0eedb63d011c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.327979 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.327957    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxx5t\" (UniqueName: \"kubernetes.io/projected/44b0d86c-8804-414e-9d46-0eedb63d011c-kube-api-access-fxx5t\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pgbdn\" (UID: \"44b0d86c-8804-414e-9d46-0eedb63d011c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.432310 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.432265    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:37.593298 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:37.593270    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"]
Jul 15 14:44:37.593949 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:44:37.593924    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b0d86c_8804_414e_9d46_0eedb63d011c.slice/crio-2c7286bb3222ddcbce505d6b783ea6852d7c2f451e26e6abc7b97e39184ae51b WatchSource:0}: Error finding container 2c7286bb3222ddcbce505d6b783ea6852d7c2f451e26e6abc7b97e39184ae51b: Status 404 returned error can't find the container with id 2c7286bb3222ddcbce505d6b783ea6852d7c2f451e26e6abc7b97e39184ae51b
Jul 15 14:44:38.427114 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:38.427082    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn" event={"ID":"44b0d86c-8804-414e-9d46-0eedb63d011c","Type":"ContainerStarted","Data":"61cc42993c37c3276074425bd6dc683845d31f654e14aadccade596f9e57d749"}
Jul 15 14:44:38.427114 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:38.427149    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn" event={"ID":"44b0d86c-8804-414e-9d46-0eedb63d011c","Type":"ContainerStarted","Data":"2c7286bb3222ddcbce505d6b783ea6852d7c2f451e26e6abc7b97e39184ae51b"}
Jul 15 14:44:38.450653 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:38.450598    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn" podStartSLOduration=1.196657204 podStartE2EDuration="1.450582887s" totalImagesPullingTime="253.925683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:44:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:44:38.448530822 +0000 UTC m=+838.341635187" watchObservedRunningTime="2026-07-15 14:44:38.450582887 +0000 UTC m=+838.343687251"
Jul 15 14:44:47.433087 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:47.433049    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:47.433535 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:47.433113    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:47.445750 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:47.445725    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:47.482615 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:47.482590    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pgbdn"
Jul 15 14:44:50.995641 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:44:50.995611    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:45:26.508525 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:45:26.508485    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:45:26.635654 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:45:26.635617    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:45:27.850697 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:45:27.850653    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:45:28.009320 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:45:28.009284    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:45:39.913965 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:45:39.913931    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:45:40.026612 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:45:40.026580    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:46:35.165774 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:46:35.165742    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:46:39.774924 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:46:39.774879    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:46:46.888605 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:46:46.888552    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:00.167602 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:00.167565    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:00.283630 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:00.283589    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5498759d79-b8p9f"]
Jul 15 14:47:00.283879 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:00.283853    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5498759d79-b8p9f" podUID="5ee9bc84-ef76-405c-8699-2fd9a7461c34" containerName="manager" containerID="cri-o://6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31" gracePeriod=30
Jul 15 14:47:00.539823 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:00.539794    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:47:00.706469 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:00.706367    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ee9bc84-ef76-405c-8699-2fd9a7461c34-webhook-cert\") pod \"5ee9bc84-ef76-405c-8699-2fd9a7461c34\" (UID: \"5ee9bc84-ef76-405c-8699-2fd9a7461c34\") "
Jul 15 14:47:00.706648 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:00.706467    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69mf6\" (UniqueName: \"kubernetes.io/projected/5ee9bc84-ef76-405c-8699-2fd9a7461c34-kube-api-access-69mf6\") pod \"5ee9bc84-ef76-405c-8699-2fd9a7461c34\" (UID: \"5ee9bc84-ef76-405c-8699-2fd9a7461c34\") "
Jul 15 14:47:00.708557 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:00.708508    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee9bc84-ef76-405c-8699-2fd9a7461c34-kube-api-access-69mf6" (OuterVolumeSpecName: "kube-api-access-69mf6") pod "5ee9bc84-ef76-405c-8699-2fd9a7461c34" (UID: "5ee9bc84-ef76-405c-8699-2fd9a7461c34"). InnerVolumeSpecName "kube-api-access-69mf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:47:00.708557 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:00.708551    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ee9bc84-ef76-405c-8699-2fd9a7461c34-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5ee9bc84-ef76-405c-8699-2fd9a7461c34" (UID: "5ee9bc84-ef76-405c-8699-2fd9a7461c34"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:47:00.807714 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:00.807684    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ee9bc84-ef76-405c-8699-2fd9a7461c34-webhook-cert\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:47:00.807714 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:00.807707    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69mf6\" (UniqueName: \"kubernetes.io/projected/5ee9bc84-ef76-405c-8699-2fd9a7461c34-kube-api-access-69mf6\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:47:01.146697 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:01.146595    2574 generic.go:356] "Generic (PLEG): container finished" podID="5ee9bc84-ef76-405c-8699-2fd9a7461c34" containerID="6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31" exitCode=0
Jul 15 14:47:01.146697 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:01.146645    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5498759d79-b8p9f"
Jul 15 14:47:01.146934 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:01.146687    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5498759d79-b8p9f" event={"ID":"5ee9bc84-ef76-405c-8699-2fd9a7461c34","Type":"ContainerDied","Data":"6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31"}
Jul 15 14:47:01.146934 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:01.146751    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5498759d79-b8p9f" event={"ID":"5ee9bc84-ef76-405c-8699-2fd9a7461c34","Type":"ContainerDied","Data":"7aecf533043381cdc6bfb6dd8fc9005f83055d4812e8bfc9587ba6cbc9457afc"}
Jul 15 14:47:01.146934 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:01.146779    2574 scope.go:117] "RemoveContainer" containerID="6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31"
Jul 15 14:47:01.155811 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:01.155791    2574 scope.go:117] "RemoveContainer" containerID="6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31"
Jul 15 14:47:01.156053 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:47:01.156034    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31\": container with ID starting with 6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31 not found: ID does not exist" containerID="6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31"
Jul 15 14:47:01.156098 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:01.156066    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31"} err="failed to get container status \"6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31\": rpc error: code = NotFound desc = could not find container \"6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31\": container with ID starting with 6f547bc6a1fb482254e17e311883ad8a13e33618fe548c38f98b2833ae5f8c31 not found: ID does not exist"
Jul 15 14:47:01.186197 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:01.186164    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5498759d79-b8p9f"]
Jul 15 14:47:01.191931 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:01.191908    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5498759d79-b8p9f"]
Jul 15 14:47:01.912315 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:01.912277    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:02.034114 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.034080    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5498759d79-brr9s"]
Jul 15 14:47:02.034579 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.034561    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee9bc84-ef76-405c-8699-2fd9a7461c34" containerName="manager"
Jul 15 14:47:02.034659 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.034582    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee9bc84-ef76-405c-8699-2fd9a7461c34" containerName="manager"
Jul 15 14:47:02.034720 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.034703    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee9bc84-ef76-405c-8699-2fd9a7461c34" containerName="manager"
Jul 15 14:47:02.039336 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.039276    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5498759d79-brr9s"
Jul 15 14:47:02.042973 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.042948    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-g6zv2\""
Jul 15 14:47:02.043103 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.042992    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 14:47:02.043976 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.043960    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 14:47:02.051250 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.051229    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5498759d79-brr9s"]
Jul 15 14:47:02.219619 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.219527    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69c4ac2b-2330-4260-83c5-b51e1a74ec9a-webhook-cert\") pod \"maas-controller-5498759d79-brr9s\" (UID: \"69c4ac2b-2330-4260-83c5-b51e1a74ec9a\") " pod="opendatahub/maas-controller-5498759d79-brr9s"
Jul 15 14:47:02.219619 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.219565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhnxx\" (UniqueName: \"kubernetes.io/projected/69c4ac2b-2330-4260-83c5-b51e1a74ec9a-kube-api-access-dhnxx\") pod \"maas-controller-5498759d79-brr9s\" (UID: \"69c4ac2b-2330-4260-83c5-b51e1a74ec9a\") " pod="opendatahub/maas-controller-5498759d79-brr9s"
Jul 15 14:47:02.320890 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.320849    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69c4ac2b-2330-4260-83c5-b51e1a74ec9a-webhook-cert\") pod \"maas-controller-5498759d79-brr9s\" (UID: \"69c4ac2b-2330-4260-83c5-b51e1a74ec9a\") " pod="opendatahub/maas-controller-5498759d79-brr9s"
Jul 15 14:47:02.320890 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.320888    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhnxx\" (UniqueName: \"kubernetes.io/projected/69c4ac2b-2330-4260-83c5-b51e1a74ec9a-kube-api-access-dhnxx\") pod \"maas-controller-5498759d79-brr9s\" (UID: \"69c4ac2b-2330-4260-83c5-b51e1a74ec9a\") " pod="opendatahub/maas-controller-5498759d79-brr9s"
Jul 15 14:47:02.323436 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.323409    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/69c4ac2b-2330-4260-83c5-b51e1a74ec9a-webhook-cert\") pod \"maas-controller-5498759d79-brr9s\" (UID: \"69c4ac2b-2330-4260-83c5-b51e1a74ec9a\") " pod="opendatahub/maas-controller-5498759d79-brr9s"
Jul 15 14:47:02.330994 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.330968    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhnxx\" (UniqueName: \"kubernetes.io/projected/69c4ac2b-2330-4260-83c5-b51e1a74ec9a-kube-api-access-dhnxx\") pod \"maas-controller-5498759d79-brr9s\" (UID: \"69c4ac2b-2330-4260-83c5-b51e1a74ec9a\") " pod="opendatahub/maas-controller-5498759d79-brr9s"
Jul 15 14:47:02.350992 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.350962    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5498759d79-brr9s"
Jul 15 14:47:02.495574 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.495494    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5498759d79-brr9s"]
Jul 15 14:47:02.498898 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:47:02.498872    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c4ac2b_2330_4260_83c5_b51e1a74ec9a.slice/crio-ce5ce73f2c6942ac776270d476f80da953f8284e4252fe2948da41f21108a5b1 WatchSource:0}: Error finding container ce5ce73f2c6942ac776270d476f80da953f8284e4252fe2948da41f21108a5b1: Status 404 returned error can't find the container with id ce5ce73f2c6942ac776270d476f80da953f8284e4252fe2948da41f21108a5b1
Jul 15 14:47:02.653893 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:02.653863    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee9bc84-ef76-405c-8699-2fd9a7461c34" path="/var/lib/kubelet/pods/5ee9bc84-ef76-405c-8699-2fd9a7461c34/volumes"
Jul 15 14:47:03.160314 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:03.160272    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5498759d79-brr9s" event={"ID":"69c4ac2b-2330-4260-83c5-b51e1a74ec9a","Type":"ContainerStarted","Data":"387b977057ce29456ce9655265d934c7a2cf3d037a4efe3bd635ce44f5069481"}
Jul 15 14:47:03.160491 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:03.160377    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5498759d79-brr9s" event={"ID":"69c4ac2b-2330-4260-83c5-b51e1a74ec9a","Type":"ContainerStarted","Data":"ce5ce73f2c6942ac776270d476f80da953f8284e4252fe2948da41f21108a5b1"}
Jul 15 14:47:03.160491 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:03.160409    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5498759d79-brr9s"
Jul 15 14:47:03.181061 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:03.181004    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5498759d79-brr9s" podStartSLOduration=0.667387598 podStartE2EDuration="1.180985784s" totalImagesPullingTime="513.598186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:47:03.179594502 +0000 UTC m=+983.072698866" watchObservedRunningTime="2026-07-15 14:47:03.180985784 +0000 UTC m=+983.074090148"
Jul 15 14:47:14.169744 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:14.169712    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5498759d79-brr9s"
Jul 15 14:47:45.536380 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:45.536327    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:45.655501 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:45.655470    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:45.782693 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:45.782661    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:52.004837 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:52.004797    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:52.153730 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:52.153692    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:52.281520 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:52.281436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:54.685314 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:54.685255    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:58.619818 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:58.619784    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:58.700241 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:47:58.700209    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:48:10.100546 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:48:10.100511    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:50:08.132590 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:50:08.132513    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:50:32.342614 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:50:32.342577    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:50:33.660851 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:50:33.660821    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:51:57.397260 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:51:57.397221    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"]
Jul 15 14:51:57.399712 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:51:57.397427    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q" podUID="de09904b-d4d0-4d79-9231-310c2d020f28" containerName="manager" containerID="cri-o://a8b0dfb5b044ea956b659ea88a7dcbc6dfa03b10a22fa50162323b86290e0524" gracePeriod=10
Jul 15 14:52:00.681877 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:00.681841    2574 generic.go:356] "Generic (PLEG): container finished" podID="de09904b-d4d0-4d79-9231-310c2d020f28" containerID="a8b0dfb5b044ea956b659ea88a7dcbc6dfa03b10a22fa50162323b86290e0524" exitCode=0
Jul 15 14:52:00.682286 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:00.681920    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q" event={"ID":"de09904b-d4d0-4d79-9231-310c2d020f28","Type":"ContainerDied","Data":"a8b0dfb5b044ea956b659ea88a7dcbc6dfa03b10a22fa50162323b86290e0524"}
Jul 15 14:52:00.744266 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:00.744220    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:52:00.839456 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:00.839420    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de09904b-d4d0-4d79-9231-310c2d020f28-extensions-socket-volume\") pod \"de09904b-d4d0-4d79-9231-310c2d020f28\" (UID: \"de09904b-d4d0-4d79-9231-310c2d020f28\") "
Jul 15 14:52:00.839629 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:00.839499    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9hsq\" (UniqueName: \"kubernetes.io/projected/de09904b-d4d0-4d79-9231-310c2d020f28-kube-api-access-z9hsq\") pod \"de09904b-d4d0-4d79-9231-310c2d020f28\" (UID: \"de09904b-d4d0-4d79-9231-310c2d020f28\") "
Jul 15 14:52:00.839883 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:00.839852    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de09904b-d4d0-4d79-9231-310c2d020f28-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "de09904b-d4d0-4d79-9231-310c2d020f28" (UID: "de09904b-d4d0-4d79-9231-310c2d020f28"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:52:00.841613 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:00.841584    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de09904b-d4d0-4d79-9231-310c2d020f28-kube-api-access-z9hsq" (OuterVolumeSpecName: "kube-api-access-z9hsq") pod "de09904b-d4d0-4d79-9231-310c2d020f28" (UID: "de09904b-d4d0-4d79-9231-310c2d020f28"). InnerVolumeSpecName "kube-api-access-z9hsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:52:00.940902 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:00.940871    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de09904b-d4d0-4d79-9231-310c2d020f28-extensions-socket-volume\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:52:00.940902 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:00.940896    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9hsq\" (UniqueName: \"kubernetes.io/projected/de09904b-d4d0-4d79-9231-310c2d020f28-kube-api-access-z9hsq\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 14:52:01.688087 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:01.688059    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"
Jul 15 14:52:01.688087 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:01.688075    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q" event={"ID":"de09904b-d4d0-4d79-9231-310c2d020f28","Type":"ContainerDied","Data":"6e7a8a1f7288292ecb77dfeee24a9cc08155ac9aa98ee6bf45c2b04497ecbb01"}
Jul 15 14:52:01.688568 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:01.688161    2574 scope.go:117] "RemoveContainer" containerID="a8b0dfb5b044ea956b659ea88a7dcbc6dfa03b10a22fa50162323b86290e0524"
Jul 15 14:52:01.710899 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:01.710860    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"]
Jul 15 14:52:01.715923 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:01.715896    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzz4q"]
Jul 15 14:52:02.652917 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:02.652888    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de09904b-d4d0-4d79-9231-310c2d020f28" path="/var/lib/kubelet/pods/de09904b-d4d0-4d79-9231-310c2d020f28/volumes"
Jul 15 14:52:58.500719 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.500681    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"]
Jul 15 14:52:58.501208 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.501108    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de09904b-d4d0-4d79-9231-310c2d020f28" containerName="manager"
Jul 15 14:52:58.501208 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.501118    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="de09904b-d4d0-4d79-9231-310c2d020f28" containerName="manager"
Jul 15 14:52:58.501208 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.501205    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="de09904b-d4d0-4d79-9231-310c2d020f28" containerName="manager"
Jul 15 14:52:58.505545 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.505526    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"
Jul 15 14:52:58.509042 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.509019    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5vgsk\""
Jul 15 14:52:58.516561 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.516539    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"]
Jul 15 14:52:58.549444 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.549383    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6646d6cc-d718-4825-a40e-8fb7cc84b1e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-25xk6\" (UID: \"6646d6cc-d718-4825-a40e-8fb7cc84b1e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"
Jul 15 14:52:58.549609 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.549494    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nslkw\" (UniqueName: \"kubernetes.io/projected/6646d6cc-d718-4825-a40e-8fb7cc84b1e2-kube-api-access-nslkw\") pod \"kuadrant-operator-controller-manager-86878c769f-25xk6\" (UID: \"6646d6cc-d718-4825-a40e-8fb7cc84b1e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"
Jul 15 14:52:58.650420 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.650382    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6646d6cc-d718-4825-a40e-8fb7cc84b1e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-25xk6\" (UID: \"6646d6cc-d718-4825-a40e-8fb7cc84b1e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"
Jul 15 14:52:58.650592 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.650477    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nslkw\" (UniqueName: \"kubernetes.io/projected/6646d6cc-d718-4825-a40e-8fb7cc84b1e2-kube-api-access-nslkw\") pod \"kuadrant-operator-controller-manager-86878c769f-25xk6\" (UID: \"6646d6cc-d718-4825-a40e-8fb7cc84b1e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"
Jul 15 14:52:58.650738 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.650720    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6646d6cc-d718-4825-a40e-8fb7cc84b1e2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-25xk6\" (UID: \"6646d6cc-d718-4825-a40e-8fb7cc84b1e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"
Jul 15 14:52:58.661711 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.661684    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nslkw\" (UniqueName: \"kubernetes.io/projected/6646d6cc-d718-4825-a40e-8fb7cc84b1e2-kube-api-access-nslkw\") pod \"kuadrant-operator-controller-manager-86878c769f-25xk6\" (UID: \"6646d6cc-d718-4825-a40e-8fb7cc84b1e2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"
Jul 15 14:52:58.816916 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.816825    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"
Jul 15 14:52:58.959549 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.959527    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"]
Jul 15 14:52:58.962520 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:52:58.962489    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6646d6cc_d718_4825_a40e_8fb7cc84b1e2.slice/crio-aa035cd2e9e945543eefadee1480c85feeb475e1a8f99abe8409b4a76bc773f2 WatchSource:0}: Error finding container aa035cd2e9e945543eefadee1480c85feeb475e1a8f99abe8409b4a76bc773f2: Status 404 returned error can't find the container with id aa035cd2e9e945543eefadee1480c85feeb475e1a8f99abe8409b4a76bc773f2
Jul 15 14:52:58.979829 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:58.979802    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6" event={"ID":"6646d6cc-d718-4825-a40e-8fb7cc84b1e2","Type":"ContainerStarted","Data":"aa035cd2e9e945543eefadee1480c85feeb475e1a8f99abe8409b4a76bc773f2"}
Jul 15 14:52:59.986437 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:59.986380    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6" event={"ID":"6646d6cc-d718-4825-a40e-8fb7cc84b1e2","Type":"ContainerStarted","Data":"cd24c856e4414a3fab2cd6a127ee23bc35abeda349b11f29e9c32bd76edf24df"}
Jul 15 14:52:59.986801 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:52:59.986506    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"
Jul 15 14:53:00.012578 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:53:00.012526    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6" podStartSLOduration=2.012510104 podStartE2EDuration="2.012510104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:53:00.010837921 +0000 UTC m=+1339.903942285" watchObservedRunningTime="2026-07-15 14:53:00.012510104 +0000 UTC m=+1339.905614468"
Jul 15 14:53:10.993745 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:53:10.993664    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-25xk6"
Jul 15 14:55:28.901887 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:55:28.901852    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:57:46.349666 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:57:46.349626    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:57:48.536720 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:57:48.536674    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:57:48.636986 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:57:48.636948    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:08.310348 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:08.310313    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:51.600562 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:51.600524    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:51.697024 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:51.696983    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:52.037461 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:52.037417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:58.043690 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:58.043659    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:58.112269 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:58.112231    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:58.281349 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:58.281319    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:58.368861 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:58.368764    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:59.364030 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.363995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:59.464299 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.464265    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:59.608462 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.608426    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"]
Jul 15 14:58:59.612193 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.612171    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:58:59.616643 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.616583    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2eb856f0-serving-cert\""
Jul 15 14:58:59.632610 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.632584    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"]
Jul 15 14:58:59.654640 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.654593    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:59.743079 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.743028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-openshift-service-ca\") pod \"maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:58:59.743079 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.743078    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz9vn\" (UniqueName: \"kubernetes.io/projected/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-kube-api-access-bz9vn\") pod \"maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:58:59.743337 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.743201    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-maas-api-tls\") pod \"maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:58:59.844416 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.844380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-openshift-service-ca\") pod \"maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:58:59.844416 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.844426    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9vn\" (UniqueName: \"kubernetes.io/projected/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-kube-api-access-bz9vn\") pod \"maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:58:59.844656 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.844472    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-maas-api-tls\") pod \"maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:58:59.844695 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:58:59.844666    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-serving-cert: secret "maas-api-e2e-ait-2eb856f0-serving-cert" not found
Jul 15 14:58:59.844741 ip-10-0-140-118 kubenswrapper[2574]: E0715 14:58:59.844731    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-maas-api-tls podName:4d755ec2-ead4-4d16-bb7c-85dc32da82ac nodeName:}" failed. No retries permitted until 2026-07-15 14:59:00.344710962 +0000 UTC m=+1700.237815313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-maas-api-tls") pod "maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4" (UID: "4d755ec2-ead4-4d16-bb7c-85dc32da82ac") : secret "maas-api-e2e-ait-2eb856f0-serving-cert" not found
Jul 15 14:58:59.845094 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.845076    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-openshift-service-ca\") pod \"maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:58:59.857651 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.857622    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz9vn\" (UniqueName: \"kubernetes.io/projected/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-kube-api-access-bz9vn\") pod \"maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:58:59.998527 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:58:59.998491    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:59:00.256554 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:00.256470    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:59:00.349621 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:00.349590    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-maas-api-tls\") pod \"maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:59:00.352180 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:00.352120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-maas-api-tls\") pod \"maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:59:00.352662 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:00.352634    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:59:00.523035 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:00.522940    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:59:00.676235 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:00.676209    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"]
Jul 15 14:59:00.678076 ip-10-0-140-118 kubenswrapper[2574]: W0715 14:59:00.678041    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d755ec2_ead4_4d16_bb7c_85dc32da82ac.slice/crio-ade1e33934ae2ddea2329d35453ede4d8b6f3bb69e1e1767b8e962d4219b9ce3 WatchSource:0}: Error finding container ade1e33934ae2ddea2329d35453ede4d8b6f3bb69e1e1767b8e962d4219b9ce3: Status 404 returned error can't find the container with id ade1e33934ae2ddea2329d35453ede4d8b6f3bb69e1e1767b8e962d4219b9ce3
Jul 15 14:59:00.679696 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:00.679674    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:59:00.866381 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:00.866289    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4" event={"ID":"4d755ec2-ead4-4d16-bb7c-85dc32da82ac","Type":"ContainerStarted","Data":"ade1e33934ae2ddea2329d35453ede4d8b6f3bb69e1e1767b8e962d4219b9ce3"}
Jul 15 14:59:01.872648 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:01.872616    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4" event={"ID":"4d755ec2-ead4-4d16-bb7c-85dc32da82ac","Type":"ContainerStarted","Data":"f9bba0d45f540a347a21d2db42bb6c7fb434d99d8e18bfd520a1df11b334e66e"}
Jul 15 14:59:01.873072 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:01.872682    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:59:01.892181 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:01.892123    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4" podStartSLOduration=2.464083891 podStartE2EDuration="2.892102683s" totalImagesPullingTime="428.018792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:59:01.889982539 +0000 UTC m=+1701.783086909" watchObservedRunningTime="2026-07-15 14:59:01.892102683 +0000 UTC m=+1701.785207048"
Jul 15 14:59:02.110678 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:02.110620    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:59:07.883814 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:07.883787    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 14:59:12.227797 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:12.227760    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 14:59:12.284329 ip-10-0-140-118 kubenswrapper[2574]: I0715 14:59:12.284297    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:00.157777 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:00.157735    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc"]
Jul 15 15:00:00.161504 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:00.161476    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc"
Jul 15 15:00:00.164458 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:00.164431    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:00:00.172047 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:00.172019    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc"]
Jul 15 15:00:00.173980 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:00.173959    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc"
Jul 15 15:00:00.313787 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:00.313757    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc"]
Jul 15 15:00:00.315784 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:00:00.315739    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4991766c_86bb_4c02_b98f_150ce2ec76e5.slice/crio-14cb6c70dbb94c256713fac1da07319ed6eeb0a85ac7031ed0063235512d9b32 WatchSource:0}: Error finding container 14cb6c70dbb94c256713fac1da07319ed6eeb0a85ac7031ed0063235512d9b32: Status 404 returned error can't find the container with id 14cb6c70dbb94c256713fac1da07319ed6eeb0a85ac7031ed0063235512d9b32
Jul 15 15:00:01.177496 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:01.177459    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc" event={"ID":"4991766c-86bb-4c02-b98f-150ce2ec76e5","Type":"ContainerStarted","Data":"14cb6c70dbb94c256713fac1da07319ed6eeb0a85ac7031ed0063235512d9b32"}
Jul 15 15:00:05.006867 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:05.006826    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"]
Jul 15 15:00:05.007396 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:05.007081    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4" podUID="4d755ec2-ead4-4d16-bb7c-85dc32da82ac" containerName="maas-api" containerID="cri-o://f9bba0d45f540a347a21d2db42bb6c7fb434d99d8e18bfd520a1df11b334e66e" gracePeriod=30
Jul 15 15:00:05.038219 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:05.038189    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc"]
Jul 15 15:00:05.047271 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:05.047181    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:05.203394 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:05.203361    2574 generic.go:356] "Generic (PLEG): container finished" podID="4d755ec2-ead4-4d16-bb7c-85dc32da82ac" containerID="f9bba0d45f540a347a21d2db42bb6c7fb434d99d8e18bfd520a1df11b334e66e" exitCode=0
Jul 15 15:00:05.203566 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:05.203434    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4" event={"ID":"4d755ec2-ead4-4d16-bb7c-85dc32da82ac","Type":"ContainerDied","Data":"f9bba0d45f540a347a21d2db42bb6c7fb434d99d8e18bfd520a1df11b334e66e"}
Jul 15 15:00:05.969506 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:05.969477    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 15:00:06.060819 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.060792    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-openshift-service-ca\") pod \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") "
Jul 15 15:00:06.061170 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.060822    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-maas-api-tls\") pod \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") "
Jul 15 15:00:06.061170 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.060882    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz9vn\" (UniqueName: \"kubernetes.io/projected/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-kube-api-access-bz9vn\") pod \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\" (UID: \"4d755ec2-ead4-4d16-bb7c-85dc32da82ac\") "
Jul 15 15:00:06.061297 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.061162    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4d755ec2-ead4-4d16-bb7c-85dc32da82ac" (UID: "4d755ec2-ead4-4d16-bb7c-85dc32da82ac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:00:06.063095 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.063070    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4d755ec2-ead4-4d16-bb7c-85dc32da82ac" (UID: "4d755ec2-ead4-4d16-bb7c-85dc32da82ac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:00:06.063095 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.063076    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-kube-api-access-bz9vn" (OuterVolumeSpecName: "kube-api-access-bz9vn") pod "4d755ec2-ead4-4d16-bb7c-85dc32da82ac" (UID: "4d755ec2-ead4-4d16-bb7c-85dc32da82ac"). InnerVolumeSpecName "kube-api-access-bz9vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:00:06.162594 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.162557    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-openshift-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:00:06.162594 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.162588    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-maas-api-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:00:06.162594 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.162599    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz9vn\" (UniqueName: \"kubernetes.io/projected/4d755ec2-ead4-4d16-bb7c-85dc32da82ac-kube-api-access-bz9vn\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:00:06.210554 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.210465    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4" event={"ID":"4d755ec2-ead4-4d16-bb7c-85dc32da82ac","Type":"ContainerDied","Data":"ade1e33934ae2ddea2329d35453ede4d8b6f3bb69e1e1767b8e962d4219b9ce3"}
Jul 15 15:00:06.210554 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.210529    2574 scope.go:117] "RemoveContainer" containerID="f9bba0d45f540a347a21d2db42bb6c7fb434d99d8e18bfd520a1df11b334e66e"
Jul 15 15:00:06.210776 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.210482    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"
Jul 15 15:00:06.237092 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.237059    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"]
Jul 15 15:00:06.243230 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.242333    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2eb856f0-7c46558d79-nxvq4"]
Jul 15 15:00:06.653782 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:06.653749    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d755ec2-ead4-4d16-bb7c-85dc32da82ac" path="/var/lib/kubelet/pods/4d755ec2-ead4-4d16-bb7c-85dc32da82ac/volumes"
Jul 15 15:00:07.217702 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:07.217665    2574 generic.go:356] "Generic (PLEG): container finished" podID="4991766c-86bb-4c02-b98f-150ce2ec76e5" containerID="997efe571eda22ffcd4b9f01c681e3318887420cd687b60ebc3acae66c87b469" exitCode=6
Jul 15 15:00:07.218203 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:07.217751    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc" event={"ID":"4991766c-86bb-4c02-b98f-150ce2ec76e5","Type":"ContainerDied","Data":"997efe571eda22ffcd4b9f01c681e3318887420cd687b60ebc3acae66c87b469"}
Jul 15 15:00:07.387399 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:07.387376    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc"
Jul 15 15:00:08.225961 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:08.225936    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc"
Jul 15 15:00:08.226371 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:08.225980    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc" event={"ID":"4991766c-86bb-4c02-b98f-150ce2ec76e5","Type":"ContainerDied","Data":"14cb6c70dbb94c256713fac1da07319ed6eeb0a85ac7031ed0063235512d9b32"}
Jul 15 15:00:08.226371 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:08.226042    2574 scope.go:117] "RemoveContainer" containerID="997efe571eda22ffcd4b9f01c681e3318887420cd687b60ebc3acae66c87b469"
Jul 15 15:00:08.251672 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:08.251643    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc"]
Jul 15 15:00:08.255658 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:08.255633    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2eb856f0-29735460-jndmc"]
Jul 15 15:00:08.653729 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:08.653701    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4991766c-86bb-4c02-b98f-150ce2ec76e5" path="/var/lib/kubelet/pods/4991766c-86bb-4c02-b98f-150ce2ec76e5/volumes"
Jul 15 15:00:09.618523 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:09.618494    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:16.049769 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:16.049734    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:16.118168 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:16.118108    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:19.924461 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:19.924421    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:20.240261 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:20.240150    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:20.348292 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:20.348253    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:20.486611 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:20.486573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:21.711307 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.711273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:21.797396 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.797366    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"]
Jul 15 15:00:21.797807 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.797790    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4991766c-86bb-4c02-b98f-150ce2ec76e5" containerName="cleanup"
Jul 15 15:00:21.797807 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.797807    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4991766c-86bb-4c02-b98f-150ce2ec76e5" containerName="cleanup"
Jul 15 15:00:21.797963 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.797832    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d755ec2-ead4-4d16-bb7c-85dc32da82ac" containerName="maas-api"
Jul 15 15:00:21.797963 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.797839    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d755ec2-ead4-4d16-bb7c-85dc32da82ac" containerName="maas-api"
Jul 15 15:00:21.797963 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.797905    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4991766c-86bb-4c02-b98f-150ce2ec76e5" containerName="cleanup"
Jul 15 15:00:21.797963 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.797918    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d755ec2-ead4-4d16-bb7c-85dc32da82ac" containerName="maas-api"
Jul 15 15:00:21.803980 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.803959    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:21.806629 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.806609    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-bf27e0e8-serving-cert\""
Jul 15 15:00:21.811480 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.811454    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"]
Jul 15 15:00:21.840628 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.840593    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:21.900551 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.900517    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-maas-api-tls\") pod \"maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:21.900726 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.900555    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-openshift-service-ca\") pod \"maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:21.900726 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.900593    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hsvm\" (UniqueName: \"kubernetes.io/projected/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-kube-api-access-2hsvm\") pod \"maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:21.960585 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:21.960552    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:22.001702 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:22.001592    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-maas-api-tls\") pod \"maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:22.001702 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:22.001628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-openshift-service-ca\") pod \"maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:22.001702 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:22.001669    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hsvm\" (UniqueName: \"kubernetes.io/projected/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-kube-api-access-2hsvm\") pod \"maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:22.002321 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:22.002296    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-openshift-service-ca\") pod \"maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:22.003985 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:22.003965    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-maas-api-tls\") pod \"maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:22.010579 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:22.010561    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hsvm\" (UniqueName: \"kubernetes.io/projected/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-kube-api-access-2hsvm\") pod \"maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:22.117187 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:22.117122    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:22.253605 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:22.253577    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"]
Jul 15 15:00:22.255527 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:00:22.255501    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509c1e34_d159_4cf7_a3b6_2dce5be7b5de.slice/crio-ecfcf5d7c2bf75a3ea3a856c08295b7d61201fef8145133d1f2061898b33016c WatchSource:0}: Error finding container ecfcf5d7c2bf75a3ea3a856c08295b7d61201fef8145133d1f2061898b33016c: Status 404 returned error can't find the container with id ecfcf5d7c2bf75a3ea3a856c08295b7d61201fef8145133d1f2061898b33016c
Jul 15 15:00:22.297708 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:22.297676    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq" event={"ID":"509c1e34-d159-4cf7-a3b6-2dce5be7b5de","Type":"ContainerStarted","Data":"ecfcf5d7c2bf75a3ea3a856c08295b7d61201fef8145133d1f2061898b33016c"}
Jul 15 15:00:22.425990 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:22.425921    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:22.536764 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:22.536645    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:23.303841 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:23.303804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq" event={"ID":"509c1e34-d159-4cf7-a3b6-2dce5be7b5de","Type":"ContainerStarted","Data":"d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0"}
Jul 15 15:00:23.304281 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:23.303871    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:23.323280 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:23.323230    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq" podStartSLOduration=1.820381644 podStartE2EDuration="2.323212129s" totalImagesPullingTime="502.830485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:00:23.322198448 +0000 UTC m=+1783.215302815" watchObservedRunningTime="2026-07-15 15:00:23.323212129 +0000 UTC m=+1783.216316531"
Jul 15 15:00:29.315016 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:29.314982    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:00:32.122605 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:32.122483    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:34.423833 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:34.423787    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:35.528172 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:00:35.528120    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:26.333392 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:26.333328    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:26.433537 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:26.433496    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:26.702298 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:26.702264    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"]
Jul 15 15:01:26.702792 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:26.702738    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq" podUID="509c1e34-d159-4cf7-a3b6-2dce5be7b5de" containerName="maas-api" containerID="cri-o://d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0" gracePeriod=30
Jul 15 15:01:26.735853 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:26.735817    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:26.963461 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:26.963403    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:01:27.105428 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.105392    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-openshift-service-ca\") pod \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") "
Jul 15 15:01:27.105428 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.105434    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hsvm\" (UniqueName: \"kubernetes.io/projected/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-kube-api-access-2hsvm\") pod \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") "
Jul 15 15:01:27.105631 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.105472    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-maas-api-tls\") pod \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\" (UID: \"509c1e34-d159-4cf7-a3b6-2dce5be7b5de\") "
Jul 15 15:01:27.105790 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.105766    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "509c1e34-d159-4cf7-a3b6-2dce5be7b5de" (UID: "509c1e34-d159-4cf7-a3b6-2dce5be7b5de"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:01:27.107587 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.107557    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "509c1e34-d159-4cf7-a3b6-2dce5be7b5de" (UID: "509c1e34-d159-4cf7-a3b6-2dce5be7b5de"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:01:27.107721 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.107669    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-kube-api-access-2hsvm" (OuterVolumeSpecName: "kube-api-access-2hsvm") pod "509c1e34-d159-4cf7-a3b6-2dce5be7b5de" (UID: "509c1e34-d159-4cf7-a3b6-2dce5be7b5de"). InnerVolumeSpecName "kube-api-access-2hsvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:01:27.206417 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.206384    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-openshift-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:01:27.206417 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.206414    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hsvm\" (UniqueName: \"kubernetes.io/projected/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-kube-api-access-2hsvm\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:01:27.206635 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.206429    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/509c1e34-d159-4cf7-a3b6-2dce5be7b5de-maas-api-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:01:27.644810 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.644778    2574 generic.go:356] "Generic (PLEG): container finished" podID="509c1e34-d159-4cf7-a3b6-2dce5be7b5de" containerID="d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0" exitCode=0
Jul 15 15:01:27.645296 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.644823    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq" event={"ID":"509c1e34-d159-4cf7-a3b6-2dce5be7b5de","Type":"ContainerDied","Data":"d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0"}
Jul 15 15:01:27.645296 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.644861    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq" event={"ID":"509c1e34-d159-4cf7-a3b6-2dce5be7b5de","Type":"ContainerDied","Data":"ecfcf5d7c2bf75a3ea3a856c08295b7d61201fef8145133d1f2061898b33016c"}
Jul 15 15:01:27.645296 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.644882    2574 scope.go:117] "RemoveContainer" containerID="d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0"
Jul 15 15:01:27.645296 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.644823    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"
Jul 15 15:01:27.653809 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.653791    2574 scope.go:117] "RemoveContainer" containerID="d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0"
Jul 15 15:01:27.654055 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:01:27.654037    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0\": container with ID starting with d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0 not found: ID does not exist" containerID="d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0"
Jul 15 15:01:27.654104 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.654064    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0"} err="failed to get container status \"d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0\": rpc error: code = NotFound desc = could not find container \"d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0\": container with ID starting with d15995e538531603adeba0b5c73a39cb2ab21374d94d216460b008d5d7c7d9e0 not found: ID does not exist"
Jul 15 15:01:27.667092 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.667068    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"]
Jul 15 15:01:27.670996 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:27.670974    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-bf27e0e8-7fb489bf47-pxzmq"]
Jul 15 15:01:28.653541 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:28.653509    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="509c1e34-d159-4cf7-a3b6-2dce5be7b5de" path="/var/lib/kubelet/pods/509c1e34-d159-4cf7-a3b6-2dce5be7b5de/volumes"
Jul 15 15:01:32.751749 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:32.751708    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:32.854779 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:32.854741    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:32.940206 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:32.940170    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:33.036279 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:33.036176    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:34.299787 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.299756    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:34.343172 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.343124    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"]
Jul 15 15:01:34.343578 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.343565    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509c1e34-d159-4cf7-a3b6-2dce5be7b5de" containerName="maas-api"
Jul 15 15:01:34.343618 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.343581    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="509c1e34-d159-4cf7-a3b6-2dce5be7b5de" containerName="maas-api"
Jul 15 15:01:34.343657 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.343651    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="509c1e34-d159-4cf7-a3b6-2dce5be7b5de" containerName="maas-api"
Jul 15 15:01:34.347999 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.347980    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:34.362482 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.362458    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-2a4ba6ba-serving-cert\""
Jul 15 15:01:34.373057 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.373030    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"]
Jul 15 15:01:34.476591 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.476559    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq96d\" (UniqueName: \"kubernetes.io/projected/4c131964-9b1b-44e3-8ccf-96afe11bf739-kube-api-access-hq96d\") pod \"maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:34.476791 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.476642    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c131964-9b1b-44e3-8ccf-96afe11bf739-openshift-service-ca\") pod \"maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:34.476791 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.476696    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c131964-9b1b-44e3-8ccf-96afe11bf739-maas-api-tls\") pod \"maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:34.524030 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.523997    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:34.577600 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.577505    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c131964-9b1b-44e3-8ccf-96afe11bf739-openshift-service-ca\") pod \"maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:34.577600 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.577578    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c131964-9b1b-44e3-8ccf-96afe11bf739-maas-api-tls\") pod \"maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:34.577842 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.577622    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq96d\" (UniqueName: \"kubernetes.io/projected/4c131964-9b1b-44e3-8ccf-96afe11bf739-kube-api-access-hq96d\") pod \"maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:34.578265 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.578242    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c131964-9b1b-44e3-8ccf-96afe11bf739-openshift-service-ca\") pod \"maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:34.580122 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.580102    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c131964-9b1b-44e3-8ccf-96afe11bf739-maas-api-tls\") pod \"maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:34.591784 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.591756    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq96d\" (UniqueName: \"kubernetes.io/projected/4c131964-9b1b-44e3-8ccf-96afe11bf739-kube-api-access-hq96d\") pod \"maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:34.611329 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.611296    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:34.658653 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.658624    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:34.799388 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:34.799354    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"]
Jul 15 15:01:34.805618 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:01:34.803212    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c131964_9b1b_44e3_8ccf_96afe11bf739.slice/crio-344d23b2dafdd4869885607fc7c523208c689bcb467192549a550e6f12cb304c WatchSource:0}: Error finding container 344d23b2dafdd4869885607fc7c523208c689bcb467192549a550e6f12cb304c: Status 404 returned error can't find the container with id 344d23b2dafdd4869885607fc7c523208c689bcb467192549a550e6f12cb304c
Jul 15 15:01:35.145523 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:35.145487    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:35.246549 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:35.246510    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:35.689055 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:35.689019    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8" event={"ID":"4c131964-9b1b-44e3-8ccf-96afe11bf739","Type":"ContainerStarted","Data":"4c1f0d727bb66fb83885037363fc58fd46c1ae5e0c188b70660e14137e64e3b0"}
Jul 15 15:01:35.689482 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:35.689073    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8" event={"ID":"4c131964-9b1b-44e3-8ccf-96afe11bf739","Type":"ContainerStarted","Data":"344d23b2dafdd4869885607fc7c523208c689bcb467192549a550e6f12cb304c"}
Jul 15 15:01:35.689482 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:35.689102    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:01:35.712551 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:35.712425    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8" podStartSLOduration=1.066873377 podStartE2EDuration="1.712403889s" totalImagesPullingTime="645.530512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:01:35.712400871 +0000 UTC m=+1855.605505238" watchObservedRunningTime="2026-07-15 15:01:35.712403889 +0000 UTC m=+1855.605508256"
Jul 15 15:01:36.309431 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:36.309394    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:41.700413 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:01:41.700379    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:02:23.133039 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:23.133000    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:23.240397 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:23.240361    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:39.785975 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:39.785934    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:39.887347 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:39.887314    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:49.837167 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:49.837122    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"]
Jul 15 15:02:49.839514 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:49.838342    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8" podUID="4c131964-9b1b-44e3-8ccf-96afe11bf739" containerName="maas-api" containerID="cri-o://4c1f0d727bb66fb83885037363fc58fd46c1ae5e0c188b70660e14137e64e3b0" gracePeriod=30
Jul 15 15:02:49.868623 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:49.868587    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:50.086021 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.085990    2574 generic.go:356] "Generic (PLEG): container finished" podID="4c131964-9b1b-44e3-8ccf-96afe11bf739" containerID="4c1f0d727bb66fb83885037363fc58fd46c1ae5e0c188b70660e14137e64e3b0" exitCode=0
Jul 15 15:02:50.086174 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.086033    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8" event={"ID":"4c131964-9b1b-44e3-8ccf-96afe11bf739","Type":"ContainerDied","Data":"4c1f0d727bb66fb83885037363fc58fd46c1ae5e0c188b70660e14137e64e3b0"}
Jul 15 15:02:50.086174 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.086083    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8" event={"ID":"4c131964-9b1b-44e3-8ccf-96afe11bf739","Type":"ContainerDied","Data":"344d23b2dafdd4869885607fc7c523208c689bcb467192549a550e6f12cb304c"}
Jul 15 15:02:50.086174 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.086102    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="344d23b2dafdd4869885607fc7c523208c689bcb467192549a550e6f12cb304c"
Jul 15 15:02:50.091686 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.091628    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:02:50.135205 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.135176    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq96d\" (UniqueName: \"kubernetes.io/projected/4c131964-9b1b-44e3-8ccf-96afe11bf739-kube-api-access-hq96d\") pod \"4c131964-9b1b-44e3-8ccf-96afe11bf739\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") "
Jul 15 15:02:50.135363 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.135244    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c131964-9b1b-44e3-8ccf-96afe11bf739-maas-api-tls\") pod \"4c131964-9b1b-44e3-8ccf-96afe11bf739\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") "
Jul 15 15:02:50.135363 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.135310    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c131964-9b1b-44e3-8ccf-96afe11bf739-openshift-service-ca\") pod \"4c131964-9b1b-44e3-8ccf-96afe11bf739\" (UID: \"4c131964-9b1b-44e3-8ccf-96afe11bf739\") "
Jul 15 15:02:50.135883 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.135854    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c131964-9b1b-44e3-8ccf-96afe11bf739-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4c131964-9b1b-44e3-8ccf-96afe11bf739" (UID: "4c131964-9b1b-44e3-8ccf-96afe11bf739"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:02:50.137853 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.137808    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c131964-9b1b-44e3-8ccf-96afe11bf739-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4c131964-9b1b-44e3-8ccf-96afe11bf739" (UID: "4c131964-9b1b-44e3-8ccf-96afe11bf739"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:02:50.138109 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.138081    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c131964-9b1b-44e3-8ccf-96afe11bf739-kube-api-access-hq96d" (OuterVolumeSpecName: "kube-api-access-hq96d") pod "4c131964-9b1b-44e3-8ccf-96afe11bf739" (UID: "4c131964-9b1b-44e3-8ccf-96afe11bf739"). InnerVolumeSpecName "kube-api-access-hq96d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:02:50.236736 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.236695    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c131964-9b1b-44e3-8ccf-96afe11bf739-openshift-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:02:50.236736 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.236735    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq96d\" (UniqueName: \"kubernetes.io/projected/4c131964-9b1b-44e3-8ccf-96afe11bf739-kube-api-access-hq96d\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:02:50.236942 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:50.236749    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c131964-9b1b-44e3-8ccf-96afe11bf739-maas-api-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:02:51.090784 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:51.090699    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"
Jul 15 15:02:51.107412 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:51.107380    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"]
Jul 15 15:02:51.110793 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:51.110767    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-2a4ba6ba-f7d46f476-bhmj8"]
Jul 15 15:02:52.652700 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:52.652668    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c131964-9b1b-44e3-8ccf-96afe11bf739" path="/var/lib/kubelet/pods/4c131964-9b1b-44e3-8ccf-96afe11bf739/volumes"
Jul 15 15:02:54.325853 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:02:54.325815    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:00.258757 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:00.258685    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:00.320913 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:00.320874    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:05.335589 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:05.335535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:05.634608 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:05.634559    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:06.730745 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.730705    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:06.810179 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.810146    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"]
Jul 15 15:03:06.810771 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.810735    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c131964-9b1b-44e3-8ccf-96afe11bf739" containerName="maas-api"
Jul 15 15:03:06.810955 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.810917    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c131964-9b1b-44e3-8ccf-96afe11bf739" containerName="maas-api"
Jul 15 15:03:06.811114 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.811058    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c131964-9b1b-44e3-8ccf-96afe11bf739" containerName="maas-api"
Jul 15 15:03:06.814970 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.814948    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:06.817776 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.817750    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-52ab34eb-serving-cert\""
Jul 15 15:03:06.828888 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.828863    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"]
Jul 15 15:03:06.832605 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.832574    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:06.885798 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.885760    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17179784-cd41-4ad9-9761-18a917d5ac01-openshift-service-ca\") pod \"maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:06.885964 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.885822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc5pp\" (UniqueName: \"kubernetes.io/projected/17179784-cd41-4ad9-9761-18a917d5ac01-kube-api-access-tc5pp\") pod \"maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:06.885964 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.885931    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17179784-cd41-4ad9-9761-18a917d5ac01-maas-api-tls\") pod \"maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:06.906446 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.906411    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:06.987154 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.987041    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc5pp\" (UniqueName: \"kubernetes.io/projected/17179784-cd41-4ad9-9761-18a917d5ac01-kube-api-access-tc5pp\") pod \"maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:06.987154 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.987094    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17179784-cd41-4ad9-9761-18a917d5ac01-maas-api-tls\") pod \"maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:06.987154 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.987155    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17179784-cd41-4ad9-9761-18a917d5ac01-openshift-service-ca\") pod \"maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:06.987380 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:03:06.987233    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-serving-cert: secret "maas-api-e2e-derive-52ab34eb-serving-cert" not found
Jul 15 15:03:06.987380 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:03:06.987338    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17179784-cd41-4ad9-9761-18a917d5ac01-maas-api-tls podName:17179784-cd41-4ad9-9761-18a917d5ac01 nodeName:}" failed. No retries permitted until 2026-07-15 15:03:07.487317352 +0000 UTC m=+1947.380421698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/17179784-cd41-4ad9-9761-18a917d5ac01-maas-api-tls") pod "maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p" (UID: "17179784-cd41-4ad9-9761-18a917d5ac01") : secret "maas-api-e2e-derive-52ab34eb-serving-cert" not found
Jul 15 15:03:06.987809 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:06.987787    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17179784-cd41-4ad9-9761-18a917d5ac01-openshift-service-ca\") pod \"maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:07.003663 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:07.003637    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc5pp\" (UniqueName: \"kubernetes.io/projected/17179784-cd41-4ad9-9761-18a917d5ac01-kube-api-access-tc5pp\") pod \"maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:07.331763 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:07.331665    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:07.446812 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:07.446775    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:07.492360 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:07.492329    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17179784-cd41-4ad9-9761-18a917d5ac01-maas-api-tls\") pod \"maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:07.495164 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:07.495119    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17179784-cd41-4ad9-9761-18a917d5ac01-maas-api-tls\") pod \"maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:07.548726 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:07.548688    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:07.729469 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:07.729436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:07.876374 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:07.876347    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"]
Jul 15 15:03:07.878519 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:03:07.878494    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17179784_cd41_4ad9_9761_18a917d5ac01.slice/crio-35574d8b75c51cc91f83c54fb31e1b393a4870e6d8c6b5952144bae575339fde WatchSource:0}: Error finding container 35574d8b75c51cc91f83c54fb31e1b393a4870e6d8c6b5952144bae575339fde: Status 404 returned error can't find the container with id 35574d8b75c51cc91f83c54fb31e1b393a4870e6d8c6b5952144bae575339fde
Jul 15 15:03:08.181156 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:08.181098    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p" event={"ID":"17179784-cd41-4ad9-9761-18a917d5ac01","Type":"ContainerStarted","Data":"35574d8b75c51cc91f83c54fb31e1b393a4870e6d8c6b5952144bae575339fde"}
Jul 15 15:03:12.202891 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:12.202852    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p" event={"ID":"17179784-cd41-4ad9-9761-18a917d5ac01","Type":"ContainerStarted","Data":"632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba"}
Jul 15 15:03:12.203361 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:12.202956    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:12.221255 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:12.221195    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p" podStartSLOduration=2.879889345 podStartE2EDuration="6.221180708s" totalImagesPullingTime="3.341291363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:03:12.220162557 +0000 UTC m=+1952.113266924" watchObservedRunningTime="2026-07-15 15:03:12.221180708 +0000 UTC m=+1952.114285123"
Jul 15 15:03:18.214657 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:18.214623    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:03:18.443537 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:18.443505    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:18.545024 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:18.544918    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:21.639906 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:03:21.639865    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:21.614664 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:21.614615    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"]
Jul 15 15:04:21.615196 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:21.614871    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p" podUID="17179784-cd41-4ad9-9761-18a917d5ac01" containerName="maas-api" containerID="cri-o://632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba" gracePeriod=30
Jul 15 15:04:21.694125 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:21.694091    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:21.873065 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:21.873001    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:04:21.981605 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:21.981574    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc5pp\" (UniqueName: \"kubernetes.io/projected/17179784-cd41-4ad9-9761-18a917d5ac01-kube-api-access-tc5pp\") pod \"17179784-cd41-4ad9-9761-18a917d5ac01\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") "
Jul 15 15:04:21.981781 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:21.981674    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17179784-cd41-4ad9-9761-18a917d5ac01-maas-api-tls\") pod \"17179784-cd41-4ad9-9761-18a917d5ac01\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") "
Jul 15 15:04:21.981781 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:21.981745    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17179784-cd41-4ad9-9761-18a917d5ac01-openshift-service-ca\") pod \"17179784-cd41-4ad9-9761-18a917d5ac01\" (UID: \"17179784-cd41-4ad9-9761-18a917d5ac01\") "
Jul 15 15:04:21.982043 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:21.982015    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17179784-cd41-4ad9-9761-18a917d5ac01-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17179784-cd41-4ad9-9761-18a917d5ac01" (UID: "17179784-cd41-4ad9-9761-18a917d5ac01"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:04:21.983653 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:21.983626    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17179784-cd41-4ad9-9761-18a917d5ac01-kube-api-access-tc5pp" (OuterVolumeSpecName: "kube-api-access-tc5pp") pod "17179784-cd41-4ad9-9761-18a917d5ac01" (UID: "17179784-cd41-4ad9-9761-18a917d5ac01"). InnerVolumeSpecName "kube-api-access-tc5pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:04:21.983758 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:21.983679    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17179784-cd41-4ad9-9761-18a917d5ac01-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17179784-cd41-4ad9-9761-18a917d5ac01" (UID: "17179784-cd41-4ad9-9761-18a917d5ac01"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:04:22.082900 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.082867    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17179784-cd41-4ad9-9761-18a917d5ac01-openshift-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:04:22.082900 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.082892    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc5pp\" (UniqueName: \"kubernetes.io/projected/17179784-cd41-4ad9-9761-18a917d5ac01-kube-api-access-tc5pp\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:04:22.082900 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.082902    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17179784-cd41-4ad9-9761-18a917d5ac01-maas-api-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:04:22.568291 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.568261    2574 generic.go:356] "Generic (PLEG): container finished" podID="17179784-cd41-4ad9-9761-18a917d5ac01" containerID="632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba" exitCode=0
Jul 15 15:04:22.568503 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.568303    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"
Jul 15 15:04:22.568503 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.568339    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p" event={"ID":"17179784-cd41-4ad9-9761-18a917d5ac01","Type":"ContainerDied","Data":"632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba"}
Jul 15 15:04:22.568503 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.568393    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p" event={"ID":"17179784-cd41-4ad9-9761-18a917d5ac01","Type":"ContainerDied","Data":"35574d8b75c51cc91f83c54fb31e1b393a4870e6d8c6b5952144bae575339fde"}
Jul 15 15:04:22.568503 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.568411    2574 scope.go:117] "RemoveContainer" containerID="632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba"
Jul 15 15:04:22.577705 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.577689    2574 scope.go:117] "RemoveContainer" containerID="632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba"
Jul 15 15:04:22.577966 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:04:22.577948    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba\": container with ID starting with 632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba not found: ID does not exist" containerID="632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba"
Jul 15 15:04:22.578030 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.577977    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba"} err="failed to get container status \"632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba\": rpc error: code = NotFound desc = could not find container \"632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba\": container with ID starting with 632882051c41ac81bea9a7e30747a73a989ed2cb8d79b5edbb7424b1580b6eba not found: ID does not exist"
Jul 15 15:04:22.590372 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.590345    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"]
Jul 15 15:04:22.594788 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.594765    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-52ab34eb-7f8d9d64cd-smc8p"]
Jul 15 15:04:22.653230 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:22.653200    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17179784-cd41-4ad9-9761-18a917d5ac01" path="/var/lib/kubelet/pods/17179784-cd41-4ad9-9761-18a917d5ac01/volumes"
Jul 15 15:04:26.242622 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:26.242580    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:32.104060 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:32.104017    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:34.530979 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:34.530943    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:36.458989 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:36.458954    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:37.058727 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:37.058694    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:37.157918 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:37.157889    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:37.258374 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:37.258335    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:38.697665 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:38.697632    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:43.041578 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:43.041543    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:44.623928 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:44.623882    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:44.726354 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:44.726315    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:44.821083 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:44.821040    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:45.314590 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:04:45.314550    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:11.168047 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:11.168010    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:17.248641 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:17.248603    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:17.352800 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:17.352760    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:17.448750 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:17.448710    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:33.314803 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:33.314767    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:38.983381 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:38.983304    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:45.059157 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:45.059099    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:49.691815 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:49.691776    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:50.500067 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:50.500030    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:56.630731 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:56.630693    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:56.774314 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:56.774279    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:57.463620 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:57.463578    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:57.563376 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:57.563344    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:57.663560 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:57.663527    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:59.214547 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:05:59.214513    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:05.194098 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:05.194057    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:05.257672 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:05.257626    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:05.840314 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:05.840281    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:11.460261 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:11.460227    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:11.517543 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:11.517493    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:11.775036 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:11.774937    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:12.022470 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:12.022433    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:12.640495 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:12.640456    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:14.673686 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.673626    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:14.750542 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.750508    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:14.757057 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.757029    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"]
Jul 15 15:06:14.757490 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.757475    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17179784-cd41-4ad9-9761-18a917d5ac01" containerName="maas-api"
Jul 15 15:06:14.757540 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.757491    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="17179784-cd41-4ad9-9761-18a917d5ac01" containerName="maas-api"
Jul 15 15:06:14.757581 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.757560    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="17179784-cd41-4ad9-9761-18a917d5ac01" containerName="maas-api"
Jul 15 15:06:14.760633 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.760617    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:14.763962 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.763940    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c91d77b6-serving-cert\""
Jul 15 15:06:14.777221 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.777190    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"]
Jul 15 15:06:14.826324 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.826284    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:14.917632 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.917589    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7mfr\" (UniqueName: \"kubernetes.io/projected/3c69f877-ed69-4c6c-afe0-89ed8664d130-kube-api-access-h7mfr\") pod \"maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:14.917827 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.917639    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c69f877-ed69-4c6c-afe0-89ed8664d130-openshift-service-ca\") pod \"maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:14.917827 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:14.917738    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c69f877-ed69-4c6c-afe0-89ed8664d130-maas-api-tls\") pod \"maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:15.018280 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.018193    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7mfr\" (UniqueName: \"kubernetes.io/projected/3c69f877-ed69-4c6c-afe0-89ed8664d130-kube-api-access-h7mfr\") pod \"maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:15.018280 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.018233    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c69f877-ed69-4c6c-afe0-89ed8664d130-openshift-service-ca\") pod \"maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:15.018477 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.018360    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c69f877-ed69-4c6c-afe0-89ed8664d130-maas-api-tls\") pod \"maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:15.018981 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.018949    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c69f877-ed69-4c6c-afe0-89ed8664d130-openshift-service-ca\") pod \"maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:15.020838 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.020809    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c69f877-ed69-4c6c-afe0-89ed8664d130-maas-api-tls\") pod \"maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:15.025226 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.025182    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:15.026695 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.026676    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7mfr\" (UniqueName: \"kubernetes.io/projected/3c69f877-ed69-4c6c-afe0-89ed8664d130-kube-api-access-h7mfr\") pod \"maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:15.071710 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.071676    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:15.359338 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.359253    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:15.415185 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.415152    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"]
Jul 15 15:06:15.417143 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:06:15.417100    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c69f877_ed69_4c6c_afe0_89ed8664d130.slice/crio-f527746af7300eb9e4cd77bb696483ac05fedbf8aee0446fd6d7a666fe402d88 WatchSource:0}: Error finding container f527746af7300eb9e4cd77bb696483ac05fedbf8aee0446fd6d7a666fe402d88: Status 404 returned error can't find the container with id f527746af7300eb9e4cd77bb696483ac05fedbf8aee0446fd6d7a666fe402d88
Jul 15 15:06:15.418863 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.418822    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:06:15.419060 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:15.419034    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:16.144551 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:16.144511    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb" event={"ID":"3c69f877-ed69-4c6c-afe0-89ed8664d130","Type":"ContainerStarted","Data":"f527746af7300eb9e4cd77bb696483ac05fedbf8aee0446fd6d7a666fe402d88"}
Jul 15 15:06:19.171439 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:19.171396    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:19.841041 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:19.841002    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:19.942639 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:19.942603    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:20.278922 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:20.278883    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:21.174609 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:21.174577    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb" event={"ID":"3c69f877-ed69-4c6c-afe0-89ed8664d130","Type":"ContainerStarted","Data":"e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547"}
Jul 15 15:06:21.174815 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:21.174701    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:21.193779 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:21.193733    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb" podStartSLOduration=2.010455384 podStartE2EDuration="7.193715971s" totalImagesPullingTime="5.183260587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:06:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:06:21.191624027 +0000 UTC m=+2141.084728404" watchObservedRunningTime="2026-07-15 15:06:21.193715971 +0000 UTC m=+2141.086820337"
Jul 15 15:06:25.568911 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:25.568871    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:25.624423 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:25.624387    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:26.081616 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:26.081579    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:27.185882 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:27.185853    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:28.678213 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:28.678175    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:36.896759 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:36.896725    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"]
Jul 15 15:06:36.897236 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:36.897123    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb" podUID="3c69f877-ed69-4c6c-afe0-89ed8664d130" containerName="maas-api" containerID="cri-o://e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547" gracePeriod=30
Jul 15 15:06:36.920725 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:36.920695    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:37.144208 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.144182    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:37.236224 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.236185    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7mfr\" (UniqueName: \"kubernetes.io/projected/3c69f877-ed69-4c6c-afe0-89ed8664d130-kube-api-access-h7mfr\") pod \"3c69f877-ed69-4c6c-afe0-89ed8664d130\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") "
Jul 15 15:06:37.236426 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.236233    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c69f877-ed69-4c6c-afe0-89ed8664d130-maas-api-tls\") pod \"3c69f877-ed69-4c6c-afe0-89ed8664d130\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") "
Jul 15 15:06:37.236426 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.236309    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c69f877-ed69-4c6c-afe0-89ed8664d130-openshift-service-ca\") pod \"3c69f877-ed69-4c6c-afe0-89ed8664d130\" (UID: \"3c69f877-ed69-4c6c-afe0-89ed8664d130\") "
Jul 15 15:06:37.236826 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.236794    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c69f877-ed69-4c6c-afe0-89ed8664d130-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c69f877-ed69-4c6c-afe0-89ed8664d130" (UID: "3c69f877-ed69-4c6c-afe0-89ed8664d130"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:06:37.238397 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.238364    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c69f877-ed69-4c6c-afe0-89ed8664d130-kube-api-access-h7mfr" (OuterVolumeSpecName: "kube-api-access-h7mfr") pod "3c69f877-ed69-4c6c-afe0-89ed8664d130" (UID: "3c69f877-ed69-4c6c-afe0-89ed8664d130"). InnerVolumeSpecName "kube-api-access-h7mfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:06:37.238771 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.238746    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c69f877-ed69-4c6c-afe0-89ed8664d130-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c69f877-ed69-4c6c-afe0-89ed8664d130" (UID: "3c69f877-ed69-4c6c-afe0-89ed8664d130"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:06:37.258438 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.258408    2574 generic.go:356] "Generic (PLEG): container finished" podID="3c69f877-ed69-4c6c-afe0-89ed8664d130" containerID="e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547" exitCode=0
Jul 15 15:06:37.258563 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.258468    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"
Jul 15 15:06:37.258563 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.258506    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb" event={"ID":"3c69f877-ed69-4c6c-afe0-89ed8664d130","Type":"ContainerDied","Data":"e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547"}
Jul 15 15:06:37.258662 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.258588    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb" event={"ID":"3c69f877-ed69-4c6c-afe0-89ed8664d130","Type":"ContainerDied","Data":"f527746af7300eb9e4cd77bb696483ac05fedbf8aee0446fd6d7a666fe402d88"}
Jul 15 15:06:37.258662 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.258611    2574 scope.go:117] "RemoveContainer" containerID="e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547"
Jul 15 15:06:37.267532 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.267512    2574 scope.go:117] "RemoveContainer" containerID="e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547"
Jul 15 15:06:37.267772 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:06:37.267753    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547\": container with ID starting with e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547 not found: ID does not exist" containerID="e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547"
Jul 15 15:06:37.267836 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.267780    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547"} err="failed to get container status \"e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547\": rpc error: code = NotFound desc = could not find container \"e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547\": container with ID starting with e2e5d09cd6b33143ca08f1a2645165a2db0108455666fe76c92fcd0026e02547 not found: ID does not exist"
Jul 15 15:06:37.279466 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.279444    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"]
Jul 15 15:06:37.286550 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.286520    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c91d77b6-6559c76b99-7fzqb"]
Jul 15 15:06:37.337927 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.337903    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c69f877-ed69-4c6c-afe0-89ed8664d130-openshift-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:06:37.337927 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.337927    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7mfr\" (UniqueName: \"kubernetes.io/projected/3c69f877-ed69-4c6c-afe0-89ed8664d130-kube-api-access-h7mfr\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:06:37.338090 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:37.337939    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c69f877-ed69-4c6c-afe0-89ed8664d130-maas-api-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:06:38.653461 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:38.653429    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c69f877-ed69-4c6c-afe0-89ed8664d130" path="/var/lib/kubelet/pods/3c69f877-ed69-4c6c-afe0-89ed8664d130/volumes"
Jul 15 15:06:41.530659 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:41.530616    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:47.461262 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:47.461210    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:47.561063 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:47.561029    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:52.184820 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:52.184783    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:52.434690 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:52.434654    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:52.566970 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:52.566864    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:52.659462 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:52.659421    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:52.767094 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:52.767060    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:58.438541 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:58.438503    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:58.541043 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:58.541010    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:58.639059 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:58.639020    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:58.767888 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:06:58.767800    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:04.544537 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:04.544488    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:07.903991 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:07.903958    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:08.005472 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:08.005438    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:11.551920 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:11.551875    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:11.880654 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:11.880555    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:12.077192 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:12.077153    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:14.716695 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:14.716649    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:14.817687 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:14.817646    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:14.991430 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:14.991342    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"]
Jul 15 15:07:14.991789 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:14.991773    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c69f877-ed69-4c6c-afe0-89ed8664d130" containerName="maas-api"
Jul 15 15:07:14.991789 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:14.991787    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c69f877-ed69-4c6c-afe0-89ed8664d130" containerName="maas-api"
Jul 15 15:07:14.991961 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:14.991890    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c69f877-ed69-4c6c-afe0-89ed8664d130" containerName="maas-api"
Jul 15 15:07:14.995176 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:14.995152    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:14.997683 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:14.997661    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ef5b05d8-serving-cert\""
Jul 15 15:07:15.004418 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.004392    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"]
Jul 15 15:07:15.029587 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.029549    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:15.085666 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.085636    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83822fdd-4702-414c-a6e7-0000fd3b7190-maas-api-tls\") pod \"maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:15.085866 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.085698    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83822fdd-4702-414c-a6e7-0000fd3b7190-openshift-service-ca\") pod \"maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:15.085866 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.085748    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw4cx\" (UniqueName: \"kubernetes.io/projected/83822fdd-4702-414c-a6e7-0000fd3b7190-kube-api-access-hw4cx\") pod \"maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:15.159654 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.159601    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:15.187226 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.187189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83822fdd-4702-414c-a6e7-0000fd3b7190-openshift-service-ca\") pod \"maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:15.187417 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.187248    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw4cx\" (UniqueName: \"kubernetes.io/projected/83822fdd-4702-414c-a6e7-0000fd3b7190-kube-api-access-hw4cx\") pod \"maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:15.187417 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.187332    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83822fdd-4702-414c-a6e7-0000fd3b7190-maas-api-tls\") pod \"maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:15.187896 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.187870    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83822fdd-4702-414c-a6e7-0000fd3b7190-openshift-service-ca\") pod \"maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:15.189793 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.189771    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83822fdd-4702-414c-a6e7-0000fd3b7190-maas-api-tls\") pod \"maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:15.195906 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.195880    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw4cx\" (UniqueName: \"kubernetes.io/projected/83822fdd-4702-414c-a6e7-0000fd3b7190-kube-api-access-hw4cx\") pod \"maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:15.309478 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.309388    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:15.448289 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.448018    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"]
Jul 15 15:07:15.450838 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:07:15.450798    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83822fdd_4702_414c_a6e7_0000fd3b7190.slice/crio-f719b3558bb4be5968fbbe6d9bfb3702a1cf3214f471d592a67591215c6300ae WatchSource:0}: Error finding container f719b3558bb4be5968fbbe6d9bfb3702a1cf3214f471d592a67591215c6300ae: Status 404 returned error can't find the container with id f719b3558bb4be5968fbbe6d9bfb3702a1cf3214f471d592a67591215c6300ae
Jul 15 15:07:15.474576 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.474541    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq" event={"ID":"83822fdd-4702-414c-a6e7-0000fd3b7190","Type":"ContainerStarted","Data":"f719b3558bb4be5968fbbe6d9bfb3702a1cf3214f471d592a67591215c6300ae"}
Jul 15 15:07:15.515695 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.515661    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:15.619924 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:15.619812    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:16.481617 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:16.481577    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq" event={"ID":"83822fdd-4702-414c-a6e7-0000fd3b7190","Type":"ContainerStarted","Data":"c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3"}
Jul 15 15:07:16.482015 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:16.481674    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:16.501515 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:16.501470    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq" podStartSLOduration=2.165620787 podStartE2EDuration="2.501454626s" totalImagesPullingTime="335.833839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:07:16.500000316 +0000 UTC m=+2196.393104683" watchObservedRunningTime="2026-07-15 15:07:16.501454626 +0000 UTC m=+2196.394558991"
Jul 15 15:07:19.223194 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:19.223153    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:22.492917 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:22.492887    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:07:24.046927 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:24.046889    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:24.149311 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:24.149271    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:25.224846 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:25.224796    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:29.259262 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:29.259225    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:36.367991 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:36.367953    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:36.468403 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:36.468369    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:40.814179 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:07:40.814121    2574 scope.go:117] "RemoveContainer" containerID="4c1f0d727bb66fb83885037363fc58fd46c1ae5e0c188b70660e14137e64e3b0"
Jul 15 15:08:02.732761 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:02.732674    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"]
Jul 15 15:08:02.735340 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:02.732903    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq" podUID="83822fdd-4702-414c-a6e7-0000fd3b7190" containerName="maas-api" containerID="cri-o://c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3" gracePeriod=30
Jul 15 15:08:02.765407 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:02.765370    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:02.988080 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:02.988020    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:08:03.121921 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.121893    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hw4cx\" (UniqueName: \"kubernetes.io/projected/83822fdd-4702-414c-a6e7-0000fd3b7190-kube-api-access-hw4cx\") pod \"83822fdd-4702-414c-a6e7-0000fd3b7190\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") "
Jul 15 15:08:03.121921 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.121926    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83822fdd-4702-414c-a6e7-0000fd3b7190-openshift-service-ca\") pod \"83822fdd-4702-414c-a6e7-0000fd3b7190\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") "
Jul 15 15:08:03.122218 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.121978    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83822fdd-4702-414c-a6e7-0000fd3b7190-maas-api-tls\") pod \"83822fdd-4702-414c-a6e7-0000fd3b7190\" (UID: \"83822fdd-4702-414c-a6e7-0000fd3b7190\") "
Jul 15 15:08:03.122375 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.122353    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83822fdd-4702-414c-a6e7-0000fd3b7190-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83822fdd-4702-414c-a6e7-0000fd3b7190" (UID: "83822fdd-4702-414c-a6e7-0000fd3b7190"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:08:03.124041 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.124008    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83822fdd-4702-414c-a6e7-0000fd3b7190-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83822fdd-4702-414c-a6e7-0000fd3b7190" (UID: "83822fdd-4702-414c-a6e7-0000fd3b7190"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:08:03.124158 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.124050    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83822fdd-4702-414c-a6e7-0000fd3b7190-kube-api-access-hw4cx" (OuterVolumeSpecName: "kube-api-access-hw4cx") pod "83822fdd-4702-414c-a6e7-0000fd3b7190" (UID: "83822fdd-4702-414c-a6e7-0000fd3b7190"). InnerVolumeSpecName "kube-api-access-hw4cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:08:03.223431 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.223397    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83822fdd-4702-414c-a6e7-0000fd3b7190-maas-api-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:08:03.223431 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.223425    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw4cx\" (UniqueName: \"kubernetes.io/projected/83822fdd-4702-414c-a6e7-0000fd3b7190-kube-api-access-hw4cx\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:08:03.223431 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.223434    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83822fdd-4702-414c-a6e7-0000fd3b7190-openshift-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:08:03.737462 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.737414    2574 generic.go:356] "Generic (PLEG): container finished" podID="83822fdd-4702-414c-a6e7-0000fd3b7190" containerID="c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3" exitCode=0
Jul 15 15:08:03.737933 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.737484    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"
Jul 15 15:08:03.737994 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.737489    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq" event={"ID":"83822fdd-4702-414c-a6e7-0000fd3b7190","Type":"ContainerDied","Data":"c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3"}
Jul 15 15:08:03.738115 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.738082    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq" event={"ID":"83822fdd-4702-414c-a6e7-0000fd3b7190","Type":"ContainerDied","Data":"f719b3558bb4be5968fbbe6d9bfb3702a1cf3214f471d592a67591215c6300ae"}
Jul 15 15:08:03.738216 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.738124    2574 scope.go:117] "RemoveContainer" containerID="c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3"
Jul 15 15:08:03.748281 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.748265    2574 scope.go:117] "RemoveContainer" containerID="c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3"
Jul 15 15:08:03.748528 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:08:03.748511    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3\": container with ID starting with c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3 not found: ID does not exist" containerID="c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3"
Jul 15 15:08:03.748578 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.748536    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3"} err="failed to get container status \"c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3\": rpc error: code = NotFound desc = could not find container \"c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3\": container with ID starting with c3e7f7e3c1dc3b64d035cd7b2939ce2e09a945f8700127254ce1d45564606be3 not found: ID does not exist"
Jul 15 15:08:03.762004 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.761977    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"]
Jul 15 15:08:03.768821 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:03.768795    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ef5b05d8-7c59b646c9-kxqnq"]
Jul 15 15:08:04.653574 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:04.653538    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83822fdd-4702-414c-a6e7-0000fd3b7190" path="/var/lib/kubelet/pods/83822fdd-4702-414c-a6e7-0000fd3b7190/volumes"
Jul 15 15:08:07.333808 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:07.333757    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:12.410390 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:12.410353    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:25.826482 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:25.826434    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:49.921565 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:49.921527    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:50.048382 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:50.048348    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:55.612039 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:08:55.612002    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:01.331165 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:01.331119    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:01.430663 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:01.430630    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:09.596317 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:09.596275    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:09.804901 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:09.804871    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:10.816364 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:10.816302    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:10.910616 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:10.910543    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:11.009955 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:11.009925    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:11.713675 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:11.713621    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:11.848217 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:11.848176    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:11.937416 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:11.937318    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:13.256781 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:13.256746    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:19.100072 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:19.100027    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:19.199840 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:19.199796    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:19.797998 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:19.797966    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:25.902148 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:25.902098    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:25.967497 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:25.967464    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:26.062146 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:26.062104    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:26.159576 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:26.159478    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:36.630776 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:36.630738    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:36.961112 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:36.961073    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:57.952428 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:09:57.952386    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:03.575411 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:03.575375    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:03.676250 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:03.676212    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:03.945524 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:03.945492    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:04.253030 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:04.252927    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:04.473589 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:04.473553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:07.459313 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.459271    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:07.546723 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.546687    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"]
Jul 15 15:10:07.547160 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.547123    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83822fdd-4702-414c-a6e7-0000fd3b7190" containerName="maas-api"
Jul 15 15:10:07.547160 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.547155    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="83822fdd-4702-414c-a6e7-0000fd3b7190" containerName="maas-api"
Jul 15 15:10:07.547314 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.547248    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="83822fdd-4702-414c-a6e7-0000fd3b7190" containerName="maas-api"
Jul 15 15:10:07.550479 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.550461    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:07.553282 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.553261    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-73bd17-serving-cert\""
Jul 15 15:10:07.563196 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.563169    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"]
Jul 15 15:10:07.566505 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.566476    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b700817d-80c9-4afe-bd86-f12c332b20d7-maas-api-tls\") pod \"maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:07.566744 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.566720    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-546v6\" (UniqueName: \"kubernetes.io/projected/b700817d-80c9-4afe-bd86-f12c332b20d7-kube-api-access-546v6\") pod \"maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:07.566872 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.566858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b700817d-80c9-4afe-bd86-f12c332b20d7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:07.567549 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.567520    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:07.667708 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.667675    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b700817d-80c9-4afe-bd86-f12c332b20d7-maas-api-tls\") pod \"maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:07.667931 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.667722    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-546v6\" (UniqueName: \"kubernetes.io/projected/b700817d-80c9-4afe-bd86-f12c332b20d7-kube-api-access-546v6\") pod \"maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:07.667931 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.667750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b700817d-80c9-4afe-bd86-f12c332b20d7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:07.667931 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:10:07.667837    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-serving-cert: secret "maas-api-e2e-inf-a-73bd17-serving-cert" not found
Jul 15 15:10:07.668222 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:10:07.667966    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b700817d-80c9-4afe-bd86-f12c332b20d7-maas-api-tls podName:b700817d-80c9-4afe-bd86-f12c332b20d7 nodeName:}" failed. No retries permitted until 2026-07-15 15:10:08.167942922 +0000 UTC m=+2368.061047268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b700817d-80c9-4afe-bd86-f12c332b20d7-maas-api-tls") pod "maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn" (UID: "b700817d-80c9-4afe-bd86-f12c332b20d7") : secret "maas-api-e2e-inf-a-73bd17-serving-cert" not found
Jul 15 15:10:07.668573 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.668552    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b700817d-80c9-4afe-bd86-f12c332b20d7-openshift-service-ca\") pod \"maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:07.678979 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:07.678954    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-546v6\" (UniqueName: \"kubernetes.io/projected/b700817d-80c9-4afe-bd86-f12c332b20d7-kube-api-access-546v6\") pod \"maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:08.062183 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:08.062108    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:08.162126 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:08.162091    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:08.171870 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:08.171844    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b700817d-80c9-4afe-bd86-f12c332b20d7-maas-api-tls\") pod \"maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:08.174369 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:08.174345    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b700817d-80c9-4afe-bd86-f12c332b20d7-maas-api-tls\") pod \"maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:08.460563 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:08.460528    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:08.535668 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:08.534436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:08.816150 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:08.816104    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"]
Jul 15 15:10:08.818036 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:10:08.818010    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb700817d_80c9_4afe_bd86_f12c332b20d7.slice/crio-a5142f7ff7fd4ec4ebcb07e76b22f73ac1af9e68903e6a62c611ffe591a53331 WatchSource:0}: Error finding container a5142f7ff7fd4ec4ebcb07e76b22f73ac1af9e68903e6a62c611ffe591a53331: Status 404 returned error can't find the container with id a5142f7ff7fd4ec4ebcb07e76b22f73ac1af9e68903e6a62c611ffe591a53331
Jul 15 15:10:09.395938 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:09.395896    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn" event={"ID":"b700817d-80c9-4afe-bd86-f12c332b20d7","Type":"ContainerStarted","Data":"fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84"}
Jul 15 15:10:09.396144 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:09.395985    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn" event={"ID":"b700817d-80c9-4afe-bd86-f12c332b20d7","Type":"ContainerStarted","Data":"a5142f7ff7fd4ec4ebcb07e76b22f73ac1af9e68903e6a62c611ffe591a53331"}
Jul 15 15:10:09.396144 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:09.396031    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:09.414905 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:09.414856    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn" podStartSLOduration=1.9976793069999998 podStartE2EDuration="2.414840421s" totalImagesPullingTime="417.161114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:10:09.413400311 +0000 UTC m=+2369.306504679" watchObservedRunningTime="2026-07-15 15:10:09.414840421 +0000 UTC m=+2369.307944787"
Jul 15 15:10:11.921296 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:11.921255    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:12.706408 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:12.706348    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:12.806968 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:12.806920    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:12.906929 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:12.906893    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:15.407472 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.407440    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:10:15.596992 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.596947    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"]
Jul 15 15:10:15.601324 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.601301    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:15.604082 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.604064    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6bbf18-serving-cert\""
Jul 15 15:10:15.612583 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.612557    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"]
Jul 15 15:10:15.641951 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.641915    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms8c9\" (UniqueName: \"kubernetes.io/projected/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-kube-api-access-ms8c9\") pod \"maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:15.642107 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.642003    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:15.642107 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.642029    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-maas-api-tls\") pod \"maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:15.742879 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.742765    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms8c9\" (UniqueName: \"kubernetes.io/projected/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-kube-api-access-ms8c9\") pod \"maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:15.743087 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.742919    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:15.743087 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.742973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-maas-api-tls\") pod \"maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:15.743657 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.743626    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:15.745909 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.745889    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-maas-api-tls\") pod \"maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:15.751813 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.751784    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms8c9\" (UniqueName: \"kubernetes.io/projected/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-kube-api-access-ms8c9\") pod \"maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:15.796383 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.796331    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:15.894398 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.894361    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:15.914367 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:15.914336    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:16.051447 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:16.051423    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"]
Jul 15 15:10:16.053100 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:10:16.053071    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9ce8d4_6ff9_43db_91ac_a23b03b29da4.slice/crio-54ad54eee3204532a70cb4968a0c87574f3c324af3e428d853c10365c7a3603b WatchSource:0}: Error finding container 54ad54eee3204532a70cb4968a0c87574f3c324af3e428d853c10365c7a3603b: Status 404 returned error can't find the container with id 54ad54eee3204532a70cb4968a0c87574f3c324af3e428d853c10365c7a3603b
Jul 15 15:10:16.282193 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:16.282084    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:16.405811 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:16.405765    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:16.438089 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:16.438059    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2" event={"ID":"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4","Type":"ContainerStarted","Data":"54ad54eee3204532a70cb4968a0c87574f3c324af3e428d853c10365c7a3603b"}
Jul 15 15:10:17.445837 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:17.445804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2" event={"ID":"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4","Type":"ContainerStarted","Data":"b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a"}
Jul 15 15:10:17.446257 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:17.445868    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:17.467471 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:17.467422    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2" podStartSLOduration=2.138922277 podStartE2EDuration="2.467403923s" totalImagesPullingTime="328.481646ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:10:17.46687107 +0000 UTC m=+2377.359975434" watchObservedRunningTime="2026-07-15 15:10:17.467403923 +0000 UTC m=+2377.360508287"
Jul 15 15:10:19.970791 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:19.970755    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:23.458589 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:23.458554    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:10:27.254778 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:27.254740    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:27.914748 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:27.914715    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:29.031396 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:29.031363    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:29.132944 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:29.132893    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:37.260616 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:37.260581    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:37.357561 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:37.357520    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:59.047231 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:10:59.047194    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:04.009463 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:04.009380    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:18.499428 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:18.499388    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:19.534591 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:19.534553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:19.644882 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:19.644841    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7"]
Jul 15 15:11:19.648597 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:19.648577    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7"
Jul 15 15:11:19.651341 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:19.651322    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:11:19.655635 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:19.655607    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7"]
Jul 15 15:11:19.748623 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:19.748573    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e496f5d4-e52a-45c5-a45d-7a376042317a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7\" (UID: \"e496f5d4-e52a-45c5-a45d-7a376042317a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7"
Jul 15 15:11:19.849975 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:19.849880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e496f5d4-e52a-45c5-a45d-7a376042317a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7\" (UID: \"e496f5d4-e52a-45c5-a45d-7a376042317a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7"
Jul 15 15:11:19.850560 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:19.850538    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e496f5d4-e52a-45c5-a45d-7a376042317a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7\" (UID: \"e496f5d4-e52a-45c5-a45d-7a376042317a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7"
Jul 15 15:11:19.961322 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:19.961285    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7"
Jul 15 15:11:20.104083 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:20.104055    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7"]
Jul 15 15:11:20.106251 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:11:20.106221    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode496f5d4_e52a_45c5_a45d_7a376042317a.slice/crio-5a2c5444ed33eb5e9e8b3f974901b5c3089fbbcc5abb0936f483a239073d29d8 WatchSource:0}: Error finding container 5a2c5444ed33eb5e9e8b3f974901b5c3089fbbcc5abb0936f483a239073d29d8: Status 404 returned error can't find the container with id 5a2c5444ed33eb5e9e8b3f974901b5c3089fbbcc5abb0936f483a239073d29d8
Jul 15 15:11:20.285041 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:20.285006    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:20.384457 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:20.384363    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:20.778512 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:20.778475    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7" event={"ID":"e496f5d4-e52a-45c5-a45d-7a376042317a","Type":"ContainerStarted","Data":"98e78beb295720a2a7d8c7659c8ab702c4688da6a8d25e1f82d7562f64554b96"}
Jul 15 15:11:20.778947 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:20.778527    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7" event={"ID":"e496f5d4-e52a-45c5-a45d-7a376042317a","Type":"ContainerStarted","Data":"5a2c5444ed33eb5e9e8b3f974901b5c3089fbbcc5abb0936f483a239073d29d8"}
Jul 15 15:11:20.794565 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:20.794517    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7" podStartSLOduration=1.794492419 podStartE2EDuration="1.794492419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:11:20.792708334 +0000 UTC m=+2440.685812702" watchObservedRunningTime="2026-07-15 15:11:20.794492419 +0000 UTC m=+2440.687596784"
Jul 15 15:11:21.785257 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:21.785218    2574 generic.go:356] "Generic (PLEG): container finished" podID="e496f5d4-e52a-45c5-a45d-7a376042317a" containerID="98e78beb295720a2a7d8c7659c8ab702c4688da6a8d25e1f82d7562f64554b96" exitCode=0
Jul 15 15:11:21.785257 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:21.785260    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7" event={"ID":"e496f5d4-e52a-45c5-a45d-7a376042317a","Type":"ContainerDied","Data":"98e78beb295720a2a7d8c7659c8ab702c4688da6a8d25e1f82d7562f64554b96"}
Jul 15 15:11:22.931381 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:22.931359    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7"
Jul 15 15:11:23.079462 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:23.079365    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e496f5d4-e52a-45c5-a45d-7a376042317a-maas-api-service-ca\") pod \"e496f5d4-e52a-45c5-a45d-7a376042317a\" (UID: \"e496f5d4-e52a-45c5-a45d-7a376042317a\") "
Jul 15 15:11:23.079724 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:23.079701    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e496f5d4-e52a-45c5-a45d-7a376042317a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e496f5d4-e52a-45c5-a45d-7a376042317a" (UID: "e496f5d4-e52a-45c5-a45d-7a376042317a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:11:23.180978 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:23.180936    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e496f5d4-e52a-45c5-a45d-7a376042317a-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:11:23.796323 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:23.796287    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7" event={"ID":"e496f5d4-e52a-45c5-a45d-7a376042317a","Type":"ContainerDied","Data":"5a2c5444ed33eb5e9e8b3f974901b5c3089fbbcc5abb0936f483a239073d29d8"}
Jul 15 15:11:23.796323 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:23.796315    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7"
Jul 15 15:11:23.796532 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:23.796336    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a2c5444ed33eb5e9e8b3f974901b5c3089fbbcc5abb0936f483a239073d29d8"
Jul 15 15:11:30.223365 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.223326    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"]
Jul 15 15:11:30.224015 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.223601    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn" podUID="b700817d-80c9-4afe-bd86-f12c332b20d7" containerName="maas-api" containerID="cri-o://fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84" gracePeriod=30
Jul 15 15:11:30.249311 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.249262    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:30.487441 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.487378    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:11:30.547921 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.547887    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-546v6\" (UniqueName: \"kubernetes.io/projected/b700817d-80c9-4afe-bd86-f12c332b20d7-kube-api-access-546v6\") pod \"b700817d-80c9-4afe-bd86-f12c332b20d7\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") "
Jul 15 15:11:30.548105 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.547944    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b700817d-80c9-4afe-bd86-f12c332b20d7-maas-api-tls\") pod \"b700817d-80c9-4afe-bd86-f12c332b20d7\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") "
Jul 15 15:11:30.548105 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.547988    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b700817d-80c9-4afe-bd86-f12c332b20d7-openshift-service-ca\") pod \"b700817d-80c9-4afe-bd86-f12c332b20d7\" (UID: \"b700817d-80c9-4afe-bd86-f12c332b20d7\") "
Jul 15 15:11:30.548393 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.548365    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b700817d-80c9-4afe-bd86-f12c332b20d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b700817d-80c9-4afe-bd86-f12c332b20d7" (UID: "b700817d-80c9-4afe-bd86-f12c332b20d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:11:30.550049 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.550026    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b700817d-80c9-4afe-bd86-f12c332b20d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b700817d-80c9-4afe-bd86-f12c332b20d7" (UID: "b700817d-80c9-4afe-bd86-f12c332b20d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:11:30.550122 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.550101    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b700817d-80c9-4afe-bd86-f12c332b20d7-kube-api-access-546v6" (OuterVolumeSpecName: "kube-api-access-546v6") pod "b700817d-80c9-4afe-bd86-f12c332b20d7" (UID: "b700817d-80c9-4afe-bd86-f12c332b20d7"). InnerVolumeSpecName "kube-api-access-546v6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:11:30.648659 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.648626    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-546v6\" (UniqueName: \"kubernetes.io/projected/b700817d-80c9-4afe-bd86-f12c332b20d7-kube-api-access-546v6\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:11:30.648659 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.648655    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b700817d-80c9-4afe-bd86-f12c332b20d7-maas-api-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:11:30.648659 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.648664    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b700817d-80c9-4afe-bd86-f12c332b20d7-openshift-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:11:30.835752 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.835556    2574 generic.go:356] "Generic (PLEG): container finished" podID="b700817d-80c9-4afe-bd86-f12c332b20d7" containerID="fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84" exitCode=0
Jul 15 15:11:30.835752 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.835611    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"
Jul 15 15:11:30.835752 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.835643    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn" event={"ID":"b700817d-80c9-4afe-bd86-f12c332b20d7","Type":"ContainerDied","Data":"fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84"}
Jul 15 15:11:30.835752 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.835694    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn" event={"ID":"b700817d-80c9-4afe-bd86-f12c332b20d7","Type":"ContainerDied","Data":"a5142f7ff7fd4ec4ebcb07e76b22f73ac1af9e68903e6a62c611ffe591a53331"}
Jul 15 15:11:30.835752 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.835723    2574 scope.go:117] "RemoveContainer" containerID="fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84"
Jul 15 15:11:30.846287 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.846264    2574 scope.go:117] "RemoveContainer" containerID="fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84"
Jul 15 15:11:30.846574 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:11:30.846556    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84\": container with ID starting with fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84 not found: ID does not exist" containerID="fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84"
Jul 15 15:11:30.846624 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.846583    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84"} err="failed to get container status \"fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84\": rpc error: code = NotFound desc = could not find container \"fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84\": container with ID starting with fd666083b7a2955ebf970ff1802f4e445489a22397b5266c63a6c4caa0f1ac84 not found: ID does not exist"
Jul 15 15:11:30.852584 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.852558    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"]
Jul 15 15:11:30.858960 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:30.858938    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn"]
Jul 15 15:11:32.654176 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:32.654120    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b700817d-80c9-4afe-bd86-f12c332b20d7" path="/var/lib/kubelet/pods/b700817d-80c9-4afe-bd86-f12c332b20d7/volumes"
Jul 15 15:11:33.402781 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:33.402733    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-73bd17-5958cd9956-rnlhn" podUID="b700817d-80c9-4afe-bd86-f12c332b20d7" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.61:8443/health\": context deadline exceeded"
Jul 15 15:11:34.730081 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:34.730041    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:40.536581 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:40.536546    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:40.636762 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:40.636729    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:45.402790 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:45.402754    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:45.679330 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:45.679235    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:46.352194 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:46.352153    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:46.455459 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:46.455410    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:56.321029 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.320989    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"]
Jul 15 15:11:56.321687 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.321325    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2" podUID="4c9ce8d4-6ff9-43db-91ac-a23b03b29da4" containerName="maas-api" containerID="cri-o://b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a" gracePeriod=30
Jul 15 15:11:56.573779 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.573719    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:11:56.685976 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.685945    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-maas-api-tls\") pod \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") "
Jul 15 15:11:56.686163 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.686006    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms8c9\" (UniqueName: \"kubernetes.io/projected/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-kube-api-access-ms8c9\") pod \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") "
Jul 15 15:11:56.686163 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.686061    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-openshift-service-ca\") pod \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\" (UID: \"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4\") "
Jul 15 15:11:56.686478 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.686455    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4c9ce8d4-6ff9-43db-91ac-a23b03b29da4" (UID: "4c9ce8d4-6ff9-43db-91ac-a23b03b29da4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:11:56.688119 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.688097    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-kube-api-access-ms8c9" (OuterVolumeSpecName: "kube-api-access-ms8c9") pod "4c9ce8d4-6ff9-43db-91ac-a23b03b29da4" (UID: "4c9ce8d4-6ff9-43db-91ac-a23b03b29da4"). InnerVolumeSpecName "kube-api-access-ms8c9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:11:56.688197 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.688112    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4c9ce8d4-6ff9-43db-91ac-a23b03b29da4" (UID: "4c9ce8d4-6ff9-43db-91ac-a23b03b29da4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:11:56.786824 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.786786    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-maas-api-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:11:56.786824 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.786818    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms8c9\" (UniqueName: \"kubernetes.io/projected/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-kube-api-access-ms8c9\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:11:56.786824 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.786832    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4-openshift-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:11:56.984688 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.984646    2574 generic.go:356] "Generic (PLEG): container finished" podID="4c9ce8d4-6ff9-43db-91ac-a23b03b29da4" containerID="b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a" exitCode=0
Jul 15 15:11:56.984866 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.984687    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2" event={"ID":"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4","Type":"ContainerDied","Data":"b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a"}
Jul 15 15:11:56.984866 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.984696    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"
Jul 15 15:11:56.984866 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.984744    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2" event={"ID":"4c9ce8d4-6ff9-43db-91ac-a23b03b29da4","Type":"ContainerDied","Data":"54ad54eee3204532a70cb4968a0c87574f3c324af3e428d853c10365c7a3603b"}
Jul 15 15:11:56.984866 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.984772    2574 scope.go:117] "RemoveContainer" containerID="b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a"
Jul 15 15:11:56.993745 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.993726    2574 scope.go:117] "RemoveContainer" containerID="b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a"
Jul 15 15:11:56.993999 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:11:56.993978    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a\": container with ID starting with b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a not found: ID does not exist" containerID="b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a"
Jul 15 15:11:56.994060 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:56.994006    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a"} err="failed to get container status \"b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a\": rpc error: code = NotFound desc = could not find container \"b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a\": container with ID starting with b4d4ec5ae0b8c3c47af26a91611c0ff777f94702146030d07114088aaa106b6a not found: ID does not exist"
Jul 15 15:11:57.005447 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:57.005423    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"]
Jul 15 15:11:57.009150 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:57.009113    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6bbf18-7bc844784b-qd7c2"]
Jul 15 15:11:58.653386 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:58.653345    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c9ce8d4-6ff9-43db-91ac-a23b03b29da4" path="/var/lib/kubelet/pods/4c9ce8d4-6ff9-43db-91ac-a23b03b29da4/volumes"
Jul 15 15:11:58.832671 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:11:58.832636    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:00.882619 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:00.882581    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:06.920096 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:06.920051    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:07.020141 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:07.020099    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:11.561959 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:11.561924    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:11.789331 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:11.789291    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:12.191026 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:12.190985    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:12.464289 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:12.464176    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:12.635745 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:12.635710    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:14.995773 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:14.995719    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:15.088253 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.088210    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:15.090103 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.090074    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"]
Jul 15 15:12:15.090574 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.090557    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e496f5d4-e52a-45c5-a45d-7a376042317a" containerName="revoke-keys"
Jul 15 15:12:15.090650 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.090578    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e496f5d4-e52a-45c5-a45d-7a376042317a" containerName="revoke-keys"
Jul 15 15:12:15.090650 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.090626    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b700817d-80c9-4afe-bd86-f12c332b20d7" containerName="maas-api"
Jul 15 15:12:15.090650 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.090636    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b700817d-80c9-4afe-bd86-f12c332b20d7" containerName="maas-api"
Jul 15 15:12:15.090650 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.090648    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c9ce8d4-6ff9-43db-91ac-a23b03b29da4" containerName="maas-api"
Jul 15 15:12:15.090843 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.090657    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c9ce8d4-6ff9-43db-91ac-a23b03b29da4" containerName="maas-api"
Jul 15 15:12:15.090843 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.090769    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e496f5d4-e52a-45c5-a45d-7a376042317a" containerName="revoke-keys"
Jul 15 15:12:15.090843 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.090784    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b700817d-80c9-4afe-bd86-f12c332b20d7" containerName="maas-api"
Jul 15 15:12:15.090843 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.090793    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c9ce8d4-6ff9-43db-91ac-a23b03b29da4" containerName="maas-api"
Jul 15 15:12:15.093305 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.093285    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:15.096114 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.096091    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-7dbf7a-serving-cert\""
Jul 15 15:12:15.104518 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.104494    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"]
Jul 15 15:12:15.161692 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.161652    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:15.261082 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.261001    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64610103-9858-4d27-af26-2b8b0c7779b8-openshift-service-ca\") pod \"maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:15.261082 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.261058    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64610103-9858-4d27-af26-2b8b0c7779b8-maas-api-tls\") pod \"maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:15.261082 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.261079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7n4t\" (UniqueName: \"kubernetes.io/projected/64610103-9858-4d27-af26-2b8b0c7779b8-kube-api-access-g7n4t\") pod \"maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:15.362689 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.362653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64610103-9858-4d27-af26-2b8b0c7779b8-openshift-service-ca\") pod \"maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:15.362878 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.362726    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64610103-9858-4d27-af26-2b8b0c7779b8-maas-api-tls\") pod \"maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:15.362878 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.362747    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7n4t\" (UniqueName: \"kubernetes.io/projected/64610103-9858-4d27-af26-2b8b0c7779b8-kube-api-access-g7n4t\") pod \"maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:15.363330 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.363310    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64610103-9858-4d27-af26-2b8b0c7779b8-openshift-service-ca\") pod \"maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:15.365213 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.365190    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64610103-9858-4d27-af26-2b8b0c7779b8-maas-api-tls\") pod \"maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:15.371519 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.371498    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7n4t\" (UniqueName: \"kubernetes.io/projected/64610103-9858-4d27-af26-2b8b0c7779b8-kube-api-access-g7n4t\") pod \"maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:15.373043 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.373018    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:15.405606 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.405575    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:15.553064 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.553030    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"]
Jul 15 15:12:15.553219 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:12:15.553031    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64610103_9858_4d27_af26_2b8b0c7779b8.slice/crio-2f99fa3bed26ec6cddab054c90c9ef9ac80e4ccea483d19fd24f35a624277eff WatchSource:0}: Error finding container 2f99fa3bed26ec6cddab054c90c9ef9ac80e4ccea483d19fd24f35a624277eff: Status 404 returned error can't find the container with id 2f99fa3bed26ec6cddab054c90c9ef9ac80e4ccea483d19fd24f35a624277eff
Jul 15 15:12:15.554492 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.554469    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:12:15.570317 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.570270    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:15.672066 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:15.672011    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:16.088531 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:16.088499    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84" event={"ID":"64610103-9858-4d27-af26-2b8b0c7779b8","Type":"ContainerStarted","Data":"6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7"}
Jul 15 15:12:16.088943 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:16.088552    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84" event={"ID":"64610103-9858-4d27-af26-2b8b0c7779b8","Type":"ContainerStarted","Data":"2f99fa3bed26ec6cddab054c90c9ef9ac80e4ccea483d19fd24f35a624277eff"}
Jul 15 15:12:16.088943 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:16.088646    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:16.107468 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:16.107413    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84" podStartSLOduration=0.684459985 podStartE2EDuration="1.107391719s" totalImagesPullingTime="422.931734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:12:16.107025285 +0000 UTC m=+2496.000129650" watchObservedRunningTime="2026-07-15 15:12:16.107391719 +0000 UTC m=+2496.000496085"
Jul 15 15:12:19.486420 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:19.486384    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:22.100698 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:22.100669    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:22.596593 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:22.596559    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:22.697351 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:22.697310    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:23.065762 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:23.065714    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:23.162262 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:23.162217    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:23.245678 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:23.245646    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:26.299812 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:26.299768    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:26.355408 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:26.355371    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:27.552317 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:27.552274    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:35.630938 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:35.630849    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh"]
Jul 15 15:12:35.634944 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:35.634919    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh"
Jul 15 15:12:35.637569 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:35.637545    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:12:35.642361 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:35.642333    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh"]
Jul 15 15:12:35.757443 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:35.757405    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh\" (UID: \"f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh"
Jul 15 15:12:35.858475 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:35.858433    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh\" (UID: \"f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh"
Jul 15 15:12:35.859047 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:35.859024    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh\" (UID: \"f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh"
Jul 15 15:12:35.950098 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:35.950061    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh"
Jul 15 15:12:36.090894 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:36.090782    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh"]
Jul 15 15:12:36.093556 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:12:36.093527    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7445bba_dc0d_4f11_bf4b_b5c277ef4cfd.slice/crio-f220bc4393bd4bb91b8b69a46523ae014ecada6d577d7e6b2002ab070a6986d2 WatchSource:0}: Error finding container f220bc4393bd4bb91b8b69a46523ae014ecada6d577d7e6b2002ab070a6986d2: Status 404 returned error can't find the container with id f220bc4393bd4bb91b8b69a46523ae014ecada6d577d7e6b2002ab070a6986d2
Jul 15 15:12:36.160912 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:36.160879    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:36.197333 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:36.197297    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh" event={"ID":"f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd","Type":"ContainerStarted","Data":"f220bc4393bd4bb91b8b69a46523ae014ecada6d577d7e6b2002ab070a6986d2"}
Jul 15 15:12:36.260191 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:36.260154    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:37.204178 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:37.204055    2574 generic.go:356] "Generic (PLEG): container finished" podID="f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd" containerID="b24c4c8476b8e7aa3496b209b03f745d200491b61dd75fe9529cb3cf0b0fcf07" exitCode=0
Jul 15 15:12:37.204178 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:37.204124    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh" event={"ID":"f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd","Type":"ContainerDied","Data":"b24c4c8476b8e7aa3496b209b03f745d200491b61dd75fe9529cb3cf0b0fcf07"}
Jul 15 15:12:38.343490 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:38.343466    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh"
Jul 15 15:12:38.480779 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:38.480691    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd-maas-api-service-ca\") pod \"f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd\" (UID: \"f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd\") "
Jul 15 15:12:38.481117 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:38.481095    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd" (UID: "f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:12:38.581323 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:38.581288    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:12:39.214401 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:39.214371    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh"
Jul 15 15:12:39.214567 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:39.214398    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh" event={"ID":"f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd","Type":"ContainerDied","Data":"f220bc4393bd4bb91b8b69a46523ae014ecada6d577d7e6b2002ab070a6986d2"}
Jul 15 15:12:39.214567 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:39.214448    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f220bc4393bd4bb91b8b69a46523ae014ecada6d577d7e6b2002ab070a6986d2"
Jul 15 15:12:44.516547 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:44.516489    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:44.616007 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:44.615976    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:46.332521 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.332481    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:46.432047 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.432010    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:46.557808 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.557776    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"]
Jul 15 15:12:46.558305 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.558273    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84" podUID="64610103-9858-4d27-af26-2b8b0c7779b8" containerName="maas-api" containerID="cri-o://6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7" gracePeriod=30
Jul 15 15:12:46.584184 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.584098    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:46.813500 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.813476    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:46.960633 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.960596    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7n4t\" (UniqueName: \"kubernetes.io/projected/64610103-9858-4d27-af26-2b8b0c7779b8-kube-api-access-g7n4t\") pod \"64610103-9858-4d27-af26-2b8b0c7779b8\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") "
Jul 15 15:12:46.960809 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.960646    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64610103-9858-4d27-af26-2b8b0c7779b8-openshift-service-ca\") pod \"64610103-9858-4d27-af26-2b8b0c7779b8\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") "
Jul 15 15:12:46.960809 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.960677    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64610103-9858-4d27-af26-2b8b0c7779b8-maas-api-tls\") pod \"64610103-9858-4d27-af26-2b8b0c7779b8\" (UID: \"64610103-9858-4d27-af26-2b8b0c7779b8\") "
Jul 15 15:12:46.961081 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.961061    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64610103-9858-4d27-af26-2b8b0c7779b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64610103-9858-4d27-af26-2b8b0c7779b8" (UID: "64610103-9858-4d27-af26-2b8b0c7779b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:12:46.962771 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.962745    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64610103-9858-4d27-af26-2b8b0c7779b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64610103-9858-4d27-af26-2b8b0c7779b8" (UID: "64610103-9858-4d27-af26-2b8b0c7779b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:12:46.962880 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:46.962774    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64610103-9858-4d27-af26-2b8b0c7779b8-kube-api-access-g7n4t" (OuterVolumeSpecName: "kube-api-access-g7n4t") pod "64610103-9858-4d27-af26-2b8b0c7779b8" (UID: "64610103-9858-4d27-af26-2b8b0c7779b8"). InnerVolumeSpecName "kube-api-access-g7n4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:12:47.062305 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.062274    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64610103-9858-4d27-af26-2b8b0c7779b8-maas-api-tls\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:12:47.062305 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.062303    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7n4t\" (UniqueName: \"kubernetes.io/projected/64610103-9858-4d27-af26-2b8b0c7779b8-kube-api-access-g7n4t\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:12:47.062305 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.062314    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64610103-9858-4d27-af26-2b8b0c7779b8-openshift-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:12:47.257176 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.257069    2574 generic.go:356] "Generic (PLEG): container finished" podID="64610103-9858-4d27-af26-2b8b0c7779b8" containerID="6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7" exitCode=0
Jul 15 15:12:47.257176 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.257108    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"
Jul 15 15:12:47.257176 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.257156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84" event={"ID":"64610103-9858-4d27-af26-2b8b0c7779b8","Type":"ContainerDied","Data":"6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7"}
Jul 15 15:12:47.257461 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.257223    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84" event={"ID":"64610103-9858-4d27-af26-2b8b0c7779b8","Type":"ContainerDied","Data":"2f99fa3bed26ec6cddab054c90c9ef9ac80e4ccea483d19fd24f35a624277eff"}
Jul 15 15:12:47.257461 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.257249    2574 scope.go:117] "RemoveContainer" containerID="6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7"
Jul 15 15:12:47.266440 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.266419    2574 scope.go:117] "RemoveContainer" containerID="6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7"
Jul 15 15:12:47.266677 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:12:47.266660    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7\": container with ID starting with 6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7 not found: ID does not exist" containerID="6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7"
Jul 15 15:12:47.266720 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.266684    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7"} err="failed to get container status \"6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7\": rpc error: code = NotFound desc = could not find container \"6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7\": container with ID starting with 6732b1b050dd6ed50b76d7f750ebca6210ca90ecb2f8eb8ba4799761a6b8e4c7 not found: ID does not exist"
Jul 15 15:12:47.279155 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.279118    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"]
Jul 15 15:12:47.282690 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:47.282670    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7dbf7a-745f4f8574-mgw84"]
Jul 15 15:12:48.653221 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:48.653167    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64610103-9858-4d27-af26-2b8b0c7779b8" path="/var/lib/kubelet/pods/64610103-9858-4d27-af26-2b8b0c7779b8/volumes"
Jul 15 15:12:50.562022 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:50.561985    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:50.661728 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:50.661695    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:50.769011 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:50.768974    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:56.526037 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:56.526005    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:56.627111 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:12:56.627067    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:01.393911 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.393872    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:01.669443 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.669408    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:01.795713 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.795670    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n"]
Jul 15 15:13:01.796210 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.796192    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64610103-9858-4d27-af26-2b8b0c7779b8" containerName="maas-api"
Jul 15 15:13:01.796319 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.796213    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="64610103-9858-4d27-af26-2b8b0c7779b8" containerName="maas-api"
Jul 15 15:13:01.796319 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.796240    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd" containerName="revoke-keys"
Jul 15 15:13:01.796319 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.796248    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd" containerName="revoke-keys"
Jul 15 15:13:01.796477 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.796357    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd" containerName="revoke-keys"
Jul 15 15:13:01.796477 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.796371    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="64610103-9858-4d27-af26-2b8b0c7779b8" containerName="maas-api"
Jul 15 15:13:01.799790 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.799769    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n"
Jul 15 15:13:01.802673 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.802650    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:13:01.808076 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.808054    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n"]
Jul 15 15:13:01.896521 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.896479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54aeb98-57d1-4d49-91bf-8cc4b0a14709-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0614af-vsp9n\" (UID: \"f54aeb98-57d1-4d49-91bf-8cc4b0a14709\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n"
Jul 15 15:13:01.997068 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.996989    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54aeb98-57d1-4d49-91bf-8cc4b0a14709-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0614af-vsp9n\" (UID: \"f54aeb98-57d1-4d49-91bf-8cc4b0a14709\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n"
Jul 15 15:13:01.997686 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:01.997668    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54aeb98-57d1-4d49-91bf-8cc4b0a14709-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0614af-vsp9n\" (UID: \"f54aeb98-57d1-4d49-91bf-8cc4b0a14709\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n"
Jul 15 15:13:02.111571 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:02.111536    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n"
Jul 15 15:13:02.243070 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:02.243026    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n"]
Jul 15 15:13:02.245625 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:13:02.245590    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54aeb98_57d1_4d49_91bf_8cc4b0a14709.slice/crio-618451dbc8ec96bec29bcb1ca8eeeab7a9e90c1f78b7f5cd27914bde5bd4cd08 WatchSource:0}: Error finding container 618451dbc8ec96bec29bcb1ca8eeeab7a9e90c1f78b7f5cd27914bde5bd4cd08: Status 404 returned error can't find the container with id 618451dbc8ec96bec29bcb1ca8eeeab7a9e90c1f78b7f5cd27914bde5bd4cd08
Jul 15 15:13:02.336993 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:02.336929    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n" event={"ID":"f54aeb98-57d1-4d49-91bf-8cc4b0a14709","Type":"ContainerStarted","Data":"618451dbc8ec96bec29bcb1ca8eeeab7a9e90c1f78b7f5cd27914bde5bd4cd08"}
Jul 15 15:13:02.402604 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:02.402554    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:02.502694 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:02.502593    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:03.343607 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:03.343508    2574 generic.go:356] "Generic (PLEG): container finished" podID="f54aeb98-57d1-4d49-91bf-8cc4b0a14709" containerID="954d3fd7b0b7d4fdfec3813ffa242186ca643486d826136aa6ccaf665a39520a" exitCode=0
Jul 15 15:13:03.343784 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:03.343595    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n" event={"ID":"f54aeb98-57d1-4d49-91bf-8cc4b0a14709","Type":"ContainerDied","Data":"954d3fd7b0b7d4fdfec3813ffa242186ca643486d826136aa6ccaf665a39520a"}
Jul 15 15:13:04.491322 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:04.491295    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n"
Jul 15 15:13:04.519707 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:04.519676    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54aeb98-57d1-4d49-91bf-8cc4b0a14709-maas-api-service-ca\") pod \"f54aeb98-57d1-4d49-91bf-8cc4b0a14709\" (UID: \"f54aeb98-57d1-4d49-91bf-8cc4b0a14709\") "
Jul 15 15:13:04.520040 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:04.520020    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f54aeb98-57d1-4d49-91bf-8cc4b0a14709-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f54aeb98-57d1-4d49-91bf-8cc4b0a14709" (UID: "f54aeb98-57d1-4d49-91bf-8cc4b0a14709"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:13:04.620461 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:04.620361    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f54aeb98-57d1-4d49-91bf-8cc4b0a14709-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:13:05.356309 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:05.356277    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n"
Jul 15 15:13:05.356482 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:05.356272    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0614af-vsp9n" event={"ID":"f54aeb98-57d1-4d49-91bf-8cc4b0a14709","Type":"ContainerDied","Data":"618451dbc8ec96bec29bcb1ca8eeeab7a9e90c1f78b7f5cd27914bde5bd4cd08"}
Jul 15 15:13:05.356482 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:05.356408    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="618451dbc8ec96bec29bcb1ca8eeeab7a9e90c1f78b7f5cd27914bde5bd4cd08"
Jul 15 15:13:12.339789 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:12.339751    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:16.877696 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:16.877657    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:22.601448 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:22.601410    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:22.666187 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:22.666143    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:27.597662 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:27.597625    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:27.836490 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:27.836451    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:28.195992 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:28.195958    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:28.542676 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:28.542586    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:28.620248 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:28.620215    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:31.682787 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:31.682753    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:31.783672 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:31.783633    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:32.096516 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:32.096404    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:32.452901 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:32.452865    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:35.955339 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:35.955303    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:36.306916 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:36.306824    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:36.730749 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:36.730703    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:36.846163 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:36.846114    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:39.469342 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:39.469299    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:41.835312 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:41.835272    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:41.894948 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:41.894903    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:43.964666 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:43.964630    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:52.895260 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:52.895222    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:52.996185 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:52.996099    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:55.327946 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:13:55.327900    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:00.894534 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:14:00.894496    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:00.993948 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:14:00.993900    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:21.726859 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:14:21.726767    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:15:00.134207 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.134143    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6"]
Jul 15 15:15:00.134835 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.134814    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f54aeb98-57d1-4d49-91bf-8cc4b0a14709" containerName="revoke-keys"
Jul 15 15:15:00.134920 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.134838    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f54aeb98-57d1-4d49-91bf-8cc4b0a14709" containerName="revoke-keys"
Jul 15 15:15:00.134980 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.134972    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f54aeb98-57d1-4d49-91bf-8cc4b0a14709" containerName="revoke-keys"
Jul 15 15:15:00.138447 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.138410    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc"]
Jul 15 15:15:00.138591 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.138558    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6"
Jul 15 15:15:00.141808 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.141781    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:15:00.143357 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.143332    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh"]
Jul 15 15:15:00.143903 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.143840    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc"
Jul 15 15:15:00.147596 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.147573    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6"]
Jul 15 15:15:00.147782 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.147759    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc"]
Jul 15 15:15:00.147890 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.147871    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh"
Jul 15 15:15:00.150340 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.150319    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh"]
Jul 15 15:15:00.155720 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.155702    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6"
Jul 15 15:15:00.162564 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.162543    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc"
Jul 15 15:15:00.197236 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.197191    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh"
Jul 15 15:15:00.325210 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.325180    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6"]
Jul 15 15:15:00.326617 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:15:00.326590    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef863ad_7062_428b_bf63_896fb6217005.slice/crio-8ab66f0732989491402b69a0a6f4a43dfc4327d4988825386d8894f29b5e23ca WatchSource:0}: Error finding container 8ab66f0732989491402b69a0a6f4a43dfc4327d4988825386d8894f29b5e23ca: Status 404 returned error can't find the container with id 8ab66f0732989491402b69a0a6f4a43dfc4327d4988825386d8894f29b5e23ca
Jul 15 15:15:00.359544 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.359518    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc"]
Jul 15 15:15:00.387341 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.387301    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh"]
Jul 15 15:15:00.397377 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:15:00.397354    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd3a38a_6310_4228_a797_8720e097177a.slice/crio-e42f796835b9a3ce7489c0dee3084d07bea3f608825154a96a99a22c6498eda4 WatchSource:0}: Error finding container e42f796835b9a3ce7489c0dee3084d07bea3f608825154a96a99a22c6498eda4: Status 404 returned error can't find the container with id e42f796835b9a3ce7489c0dee3084d07bea3f608825154a96a99a22c6498eda4
Jul 15 15:15:00.986305 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.986262    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6" event={"ID":"0ef863ad-7062-428b-bf63-896fb6217005","Type":"ContainerStarted","Data":"f928b53b31322d76799afc6de2d2cee7995d93fa13e902da80634f5a8c3baa2f"}
Jul 15 15:15:00.986758 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.986330    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6" event={"ID":"0ef863ad-7062-428b-bf63-896fb6217005","Type":"ContainerStarted","Data":"8ab66f0732989491402b69a0a6f4a43dfc4327d4988825386d8894f29b5e23ca"}
Jul 15 15:15:00.991015 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.990982    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh" event={"ID":"abd3a38a-6310-4228-a797-8720e097177a","Type":"ContainerStarted","Data":"59c6214ee739761b8b5328fb1ee76e9c5fcc3b7f52ac9db0afb3fcb4bf78b606"}
Jul 15 15:15:00.991219 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.991037    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh" event={"ID":"abd3a38a-6310-4228-a797-8720e097177a","Type":"ContainerStarted","Data":"e42f796835b9a3ce7489c0dee3084d07bea3f608825154a96a99a22c6498eda4"}
Jul 15 15:15:00.992828 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.992803    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc" event={"ID":"fd340de9-84d7-406d-b792-7b4e2cbce428","Type":"ContainerStarted","Data":"c8354f9a37e551b367cc96188ad73d48947ed950cd10575efe0d84ebde96c0eb"}
Jul 15 15:15:00.992937 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:00.992849    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc" event={"ID":"fd340de9-84d7-406d-b792-7b4e2cbce428","Type":"ContainerStarted","Data":"53c2fa8726b478c836a8eac5833218e4543521f61330343238f930ceccf64c06"}
Jul 15 15:15:01.004774 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:01.004734    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6" podStartSLOduration=1.004719833 podStartE2EDuration="1.004719833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:15:01.002262118 +0000 UTC m=+2660.895366484" watchObservedRunningTime="2026-07-15 15:15:01.004719833 +0000 UTC m=+2660.897824237"
Jul 15 15:15:01.020637 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:01.020593    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc" podStartSLOduration=1.0205795 podStartE2EDuration="1.0205795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:15:01.020004521 +0000 UTC m=+2660.913108886" watchObservedRunningTime="2026-07-15 15:15:01.0205795 +0000 UTC m=+2660.913683864"
Jul 15 15:15:01.040691 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:01.040645    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh" podStartSLOduration=1.040629413 podStartE2EDuration="1.040629413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:15:01.039163907 +0000 UTC m=+2660.932268275" watchObservedRunningTime="2026-07-15 15:15:01.040629413 +0000 UTC m=+2660.933733778"
Jul 15 15:15:02.000110 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:02.000078    2574 generic.go:356] "Generic (PLEG): container finished" podID="abd3a38a-6310-4228-a797-8720e097177a" containerID="59c6214ee739761b8b5328fb1ee76e9c5fcc3b7f52ac9db0afb3fcb4bf78b606" exitCode=0
Jul 15 15:15:02.000538 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:02.000161    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh" event={"ID":"abd3a38a-6310-4228-a797-8720e097177a","Type":"ContainerDied","Data":"59c6214ee739761b8b5328fb1ee76e9c5fcc3b7f52ac9db0afb3fcb4bf78b606"}
Jul 15 15:15:02.001728 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:02.001700    2574 generic.go:356] "Generic (PLEG): container finished" podID="fd340de9-84d7-406d-b792-7b4e2cbce428" containerID="c8354f9a37e551b367cc96188ad73d48947ed950cd10575efe0d84ebde96c0eb" exitCode=0
Jul 15 15:15:02.001844 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:02.001786    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc" event={"ID":"fd340de9-84d7-406d-b792-7b4e2cbce428","Type":"ContainerDied","Data":"c8354f9a37e551b367cc96188ad73d48947ed950cd10575efe0d84ebde96c0eb"}
Jul 15 15:15:02.003253 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:02.003231    2574 generic.go:356] "Generic (PLEG): container finished" podID="0ef863ad-7062-428b-bf63-896fb6217005" containerID="f928b53b31322d76799afc6de2d2cee7995d93fa13e902da80634f5a8c3baa2f" exitCode=0
Jul 15 15:15:02.003343 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:02.003304    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6" event={"ID":"0ef863ad-7062-428b-bf63-896fb6217005","Type":"ContainerDied","Data":"f928b53b31322d76799afc6de2d2cee7995d93fa13e902da80634f5a8c3baa2f"}
Jul 15 15:15:03.193862 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:03.193839    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc"
Jul 15 15:15:03.196938 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:03.196918    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh"
Jul 15 15:15:03.200654 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:03.200636    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6"
Jul 15 15:15:04.014890 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:04.014862    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh"
Jul 15 15:15:04.015076 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:04.014864    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh" event={"ID":"abd3a38a-6310-4228-a797-8720e097177a","Type":"ContainerDied","Data":"e42f796835b9a3ce7489c0dee3084d07bea3f608825154a96a99a22c6498eda4"}
Jul 15 15:15:04.015076 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:04.014998    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e42f796835b9a3ce7489c0dee3084d07bea3f608825154a96a99a22c6498eda4"
Jul 15 15:15:04.016147 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:04.016116    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc"
Jul 15 15:15:04.016269 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:04.016159    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-scgnc" event={"ID":"fd340de9-84d7-406d-b792-7b4e2cbce428","Type":"ContainerDied","Data":"53c2fa8726b478c836a8eac5833218e4543521f61330343238f930ceccf64c06"}
Jul 15 15:15:04.016269 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:04.016205    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53c2fa8726b478c836a8eac5833218e4543521f61330343238f930ceccf64c06"
Jul 15 15:15:04.017633 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:04.017612    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6" event={"ID":"0ef863ad-7062-428b-bf63-896fb6217005","Type":"ContainerDied","Data":"8ab66f0732989491402b69a0a6f4a43dfc4327d4988825386d8894f29b5e23ca"}
Jul 15 15:15:04.017633 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:04.017630    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6"
Jul 15 15:15:04.017754 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:04.017649    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ab66f0732989491402b69a0a6f4a43dfc4327d4988825386d8894f29b5e23ca"
Jul 15 15:15:35.856654 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:35.856557    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:15:47.467308 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:15:47.467263    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:16:29.671214 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:16:29.671178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:16:31.327204 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:16:31.327165    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:16:36.348764 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:16:36.348723    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:16:44.035526 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:16:44.035485    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:17:12.621279 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:17:12.621153    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:17:25.882939 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:17:25.882896    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:17:25.988206 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:17:25.988172    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:17:27.258328 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:17:27.258291    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:07.464549 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:18:07.464505    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:08.395889 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:18:08.395848    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:26.036240 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:18:26.036195    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:30.759986 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:18:30.759951    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:30.820653 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:18:30.820612    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:53.221053 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:18:53.221017    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:53.688882 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:18:53.688850    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:53.789724 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:18:53.789689    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:19:01.730240 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:01.730195    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:19:01.833979 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:01.833935    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:19:43.798888 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:43.798847    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:19:44.798042 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:44.798000    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:19:49.122326 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.122288    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7363-140105960890544"]
Jul 15 15:19:49.122727 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.122714    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abd3a38a-6310-4228-a797-8720e097177a" containerName="cleanup"
Jul 15 15:19:49.122727 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.122727    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="abd3a38a-6310-4228-a797-8720e097177a" containerName="cleanup"
Jul 15 15:19:49.122800 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.122747    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ef863ad-7062-428b-bf63-896fb6217005" containerName="cleanup"
Jul 15 15:19:49.122800 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.122752    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ef863ad-7062-428b-bf63-896fb6217005" containerName="cleanup"
Jul 15 15:19:49.122800 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.122762    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd340de9-84d7-406d-b792-7b4e2cbce428" containerName="cleanup"
Jul 15 15:19:49.122800 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.122768    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd340de9-84d7-406d-b792-7b4e2cbce428" containerName="cleanup"
Jul 15 15:19:49.122925 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.122824    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ef863ad-7062-428b-bf63-896fb6217005" containerName="cleanup"
Jul 15 15:19:49.122925 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.122831    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd340de9-84d7-406d-b792-7b4e2cbce428" containerName="cleanup"
Jul 15 15:19:49.122925 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.122837    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="abd3a38a-6310-4228-a797-8720e097177a" containerName="cleanup"
Jul 15 15:19:49.126041 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.126021    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960890544"
Jul 15 15:19:49.128957 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.128935    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xbz6z\""
Jul 15 15:19:49.132021 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.131994    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105960890544"]
Jul 15 15:19:49.211375 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.211341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kncjc\" (UniqueName: \"kubernetes.io/projected/63cf74fc-0e25-4344-acf2-ce7cec4ce949-kube-api-access-kncjc\") pod \"test-curl-7363-140105960890544\" (UID: \"63cf74fc-0e25-4344-acf2-ce7cec4ce949\") " pod="opendatahub/test-curl-7363-140105960890544"
Jul 15 15:19:49.312694 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.312653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kncjc\" (UniqueName: \"kubernetes.io/projected/63cf74fc-0e25-4344-acf2-ce7cec4ce949-kube-api-access-kncjc\") pod \"test-curl-7363-140105960890544\" (UID: \"63cf74fc-0e25-4344-acf2-ce7cec4ce949\") " pod="opendatahub/test-curl-7363-140105960890544"
Jul 15 15:19:49.321593 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.321558    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kncjc\" (UniqueName: \"kubernetes.io/projected/63cf74fc-0e25-4344-acf2-ce7cec4ce949-kube-api-access-kncjc\") pod \"test-curl-7363-140105960890544\" (UID: \"63cf74fc-0e25-4344-acf2-ce7cec4ce949\") " pod="opendatahub/test-curl-7363-140105960890544"
Jul 15 15:19:49.437628 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.437593    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960890544"
Jul 15 15:19:49.577248 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.577197    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7363-140105960890544"]
Jul 15 15:19:49.578215 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:19:49.578181    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63cf74fc_0e25_4344_acf2_ce7cec4ce949.slice/crio-ef340473da8698b50cd06ca8a0a2ce8bdadc989430ec757fadba95c0851d39cf WatchSource:0}: Error finding container ef340473da8698b50cd06ca8a0a2ce8bdadc989430ec757fadba95c0851d39cf: Status 404 returned error can't find the container with id ef340473da8698b50cd06ca8a0a2ce8bdadc989430ec757fadba95c0851d39cf
Jul 15 15:19:49.579689 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:49.579671    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:19:50.561321 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:50.561284    2574 generic.go:356] "Generic (PLEG): container finished" podID="63cf74fc-0e25-4344-acf2-ce7cec4ce949" containerID="6be37c344732dbd5797f26358d3b48083a90a5cbfa36e24719f0d6e0509086df" exitCode=0
Jul 15 15:19:50.561729 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:50.561368    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105960890544" event={"ID":"63cf74fc-0e25-4344-acf2-ce7cec4ce949","Type":"ContainerDied","Data":"6be37c344732dbd5797f26358d3b48083a90a5cbfa36e24719f0d6e0509086df"}
Jul 15 15:19:50.561729 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:50.561412    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7363-140105960890544" event={"ID":"63cf74fc-0e25-4344-acf2-ce7cec4ce949","Type":"ContainerStarted","Data":"ef340473da8698b50cd06ca8a0a2ce8bdadc989430ec757fadba95c0851d39cf"}
Jul 15 15:19:51.706723 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:51.706696    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960890544"
Jul 15 15:19:51.727318 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:51.727293    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7363-140105960890544_63cf74fc-0e25-4344-acf2-ce7cec4ce949/test-curl-7363-140105960890544/0.log"
Jul 15 15:19:51.736407 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:51.736378    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kncjc\" (UniqueName: \"kubernetes.io/projected/63cf74fc-0e25-4344-acf2-ce7cec4ce949-kube-api-access-kncjc\") pod \"63cf74fc-0e25-4344-acf2-ce7cec4ce949\" (UID: \"63cf74fc-0e25-4344-acf2-ce7cec4ce949\") "
Jul 15 15:19:51.738627 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:51.738593    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63cf74fc-0e25-4344-acf2-ce7cec4ce949-kube-api-access-kncjc" (OuterVolumeSpecName: "kube-api-access-kncjc") pod "63cf74fc-0e25-4344-acf2-ce7cec4ce949" (UID: "63cf74fc-0e25-4344-acf2-ce7cec4ce949"). InnerVolumeSpecName "kube-api-access-kncjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:19:51.752378 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:51.752349    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7363-140105960890544"]
Jul 15 15:19:51.755725 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:51.755700    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7363-140105960890544"]
Jul 15 15:19:51.837503 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:51.837416    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kncjc\" (UniqueName: \"kubernetes.io/projected/63cf74fc-0e25-4344-acf2-ce7cec4ce949-kube-api-access-kncjc\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:19:52.573955 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:52.573920    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7363-140105960890544"
Jul 15 15:19:52.574110 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:52.573928    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef340473da8698b50cd06ca8a0a2ce8bdadc989430ec757fadba95c0851d39cf"
Jul 15 15:19:52.584093 ip-10-0-140-118 kubenswrapper[2574]: E0715 15:19:52.584064    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7363-140105960890544\" is forbidden: User \"system:node:ip-10-0-140-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-118.ec2.internal' and this object" podUID="63cf74fc-0e25-4344-acf2-ce7cec4ce949" pod="opendatahub/test-curl-7363-140105960890544"
Jul 15 15:19:52.652907 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:19:52.652879    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63cf74fc-0e25-4344-acf2-ce7cec4ce949" path="/var/lib/kubelet/pods/63cf74fc-0e25-4344-acf2-ce7cec4ce949/volumes"
Jul 15 15:20:03.803466 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:03.803388    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:04.439145 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:04.439101    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:13.751011 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:13.750976    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:13.758363 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:13.758325    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6"]
Jul 15 15:20:13.761915 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:13.761888    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e7a94a-29735475-5qzb6"]
Jul 15 15:20:14.653933 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:14.653898    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ef863ad-7062-428b-bf63-896fb6217005" path="/var/lib/kubelet/pods/0ef863ad-7062-428b-bf63-896fb6217005/volumes"
Jul 15 15:20:20.262957 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:20.262917    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:21.383759 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:21.383699    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:24.479899 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:24.479860    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:24.592803 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:24.592771    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:29.065390 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.065351    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:29.280946 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.280910    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:29.394385 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.394286    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g"]
Jul 15 15:20:29.394805 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.394788    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63cf74fc-0e25-4344-acf2-ce7cec4ce949" containerName="test-curl-7363-140105960890544"
Jul 15 15:20:29.394805 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.394805    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="63cf74fc-0e25-4344-acf2-ce7cec4ce949" containerName="test-curl-7363-140105960890544"
Jul 15 15:20:29.394925 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.394887    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="63cf74fc-0e25-4344-acf2-ce7cec4ce949" containerName="test-curl-7363-140105960890544"
Jul 15 15:20:29.398204 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.398182    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g"
Jul 15 15:20:29.401053 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.401028    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5f2t\""
Jul 15 15:20:29.405476 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.405431    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g"]
Jul 15 15:20:29.591009 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.590975    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f633731b-176f-499b-9f58-509b1685ca6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g\" (UID: \"f633731b-176f-499b-9f58-509b1685ca6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g"
Jul 15 15:20:29.692563 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.692525    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f633731b-176f-499b-9f58-509b1685ca6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g\" (UID: \"f633731b-176f-499b-9f58-509b1685ca6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g"
Jul 15 15:20:29.693260 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.693238    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f633731b-176f-499b-9f58-509b1685ca6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g\" (UID: \"f633731b-176f-499b-9f58-509b1685ca6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g"
Jul 15 15:20:29.710046 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:29.710020    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g"
Jul 15 15:20:30.053506 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:30.053478    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g"]
Jul 15 15:20:30.056233 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:20:30.056202    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf633731b_176f_499b_9f58_509b1685ca6f.slice/crio-0047056f52bf724da61c5309378bcd03db84c0732a30e9af728ce786f64ca7ff WatchSource:0}: Error finding container 0047056f52bf724da61c5309378bcd03db84c0732a30e9af728ce786f64ca7ff: Status 404 returned error can't find the container with id 0047056f52bf724da61c5309378bcd03db84c0732a30e9af728ce786f64ca7ff
Jul 15 15:20:30.789080 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:30.789045    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g" event={"ID":"f633731b-176f-499b-9f58-509b1685ca6f","Type":"ContainerStarted","Data":"6728b8eda324acaa7ea7d0d94d70de9ebf34f4a62a3858f55e58e6929460533e"}
Jul 15 15:20:30.789504 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:30.789100    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g" event={"ID":"f633731b-176f-499b-9f58-509b1685ca6f","Type":"ContainerStarted","Data":"0047056f52bf724da61c5309378bcd03db84c0732a30e9af728ce786f64ca7ff"}
Jul 15 15:20:30.806229 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:30.806184    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g" podStartSLOduration=1.806168951 podStartE2EDuration="1.806168951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:20:30.804270955 +0000 UTC m=+2990.697375325" watchObservedRunningTime="2026-07-15 15:20:30.806168951 +0000 UTC m=+2990.699273353"
Jul 15 15:20:31.795522 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:31.795488    2574 generic.go:356] "Generic (PLEG): container finished" podID="f633731b-176f-499b-9f58-509b1685ca6f" containerID="6728b8eda324acaa7ea7d0d94d70de9ebf34f4a62a3858f55e58e6929460533e" exitCode=0
Jul 15 15:20:31.795971 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:31.795586    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g" event={"ID":"f633731b-176f-499b-9f58-509b1685ca6f","Type":"ContainerDied","Data":"6728b8eda324acaa7ea7d0d94d70de9ebf34f4a62a3858f55e58e6929460533e"}
Jul 15 15:20:32.015202 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:32.015157    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:32.116466 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:32.116365    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:32.944142 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:32.944112    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g"
Jul 15 15:20:33.020644 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:33.020614    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f633731b-176f-499b-9f58-509b1685ca6f-maas-api-service-ca\") pod \"f633731b-176f-499b-9f58-509b1685ca6f\" (UID: \"f633731b-176f-499b-9f58-509b1685ca6f\") "
Jul 15 15:20:33.020953 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:33.020932    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f633731b-176f-499b-9f58-509b1685ca6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f633731b-176f-499b-9f58-509b1685ca6f" (UID: "f633731b-176f-499b-9f58-509b1685ca6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:20:33.121359 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:33.121269    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f633731b-176f-499b-9f58-509b1685ca6f-maas-api-service-ca\") on node \"ip-10-0-140-118.ec2.internal\" DevicePath \"\""
Jul 15 15:20:33.814306 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:33.814266    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g" event={"ID":"f633731b-176f-499b-9f58-509b1685ca6f","Type":"ContainerDied","Data":"0047056f52bf724da61c5309378bcd03db84c0732a30e9af728ce786f64ca7ff"}
Jul 15 15:20:33.814468 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:33.814349    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0047056f52bf724da61c5309378bcd03db84c0732a30e9af728ce786f64ca7ff"
Jul 15 15:20:33.814468 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:33.814279    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g"
Jul 15 15:20:39.860641 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:39.860606    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh"]
Jul 15 15:20:39.861085 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:39.860676    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:39.863387 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:39.863361    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-9f9f5c-29735475-f8rbh"]
Jul 15 15:20:40.653447 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:40.653414    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abd3a38a-6310-4228-a797-8720e097177a" path="/var/lib/kubelet/pods/abd3a38a-6310-4228-a797-8720e097177a/volumes"
Jul 15 15:20:44.486997 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:44.486963    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:50.041554 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:50.041522    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:50.492921 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:50.492885    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:52.562160 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:52.562101    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:55.147808 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:55.147766    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:55.373324 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:20:55.373281    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:01.060263 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:01.060222    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jwscq_8b1d83ae-11b0-4164-886c-0f11faab6c7b/manager/0.log"
Jul 15 15:21:01.181209 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:01.181170    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l92vm_00200266-83dc-421a-8a60-52c89a10f6ea/manager/0.log"
Jul 15 15:21:01.309693 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:01.309657    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5498759d79-brr9s_69c4ac2b-2330-4260-83c5-b51e1a74ec9a/manager/0.log"
Jul 15 15:21:01.419970 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:01.419920    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-78lwg_e75bb13e-4efb-4351-b86e-c6352787b709/server/0.log"
Jul 15 15:21:01.545764 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:01.545727    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lsmqk_fe634588-29b9-4afe-a83d-33ed0982c29f/manager/0.log"
Jul 15 15:21:01.792110 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:01.792004    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-g4wcv_9aec7704-c886-45ea-b7d9-ad56da099b7f/copy-manifests/0.log"
Jul 15 15:21:01.809909 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:01.809878    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-g4wcv_9aec7704-c886-45ea-b7d9-ad56da099b7f/manager/0.log"
Jul 15 15:21:02.315445 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:02.315419    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-76cddc5c78-nbb56_e614bf1a-209b-432d-864b-df6c76921d35/maas-api/0.log"
Jul 15 15:21:02.632006 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:02.631927    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735475-scgnc_fd340de9-84d7-406d-b792-7b4e2cbce428/cleanup/0.log"
Jul 15 15:21:02.968233 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:02.968201    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-7dbf7a-fgsvh_f7445bba-dc0d-4f11-bf4b-b5c277ef4cfd/revoke-keys/0.log"
Jul 15 15:21:03.072989 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:03.072960    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-0614af-vsp9n_f54aeb98-57d1-4d49-91bf-8cc4b0a14709/revoke-keys/0.log"
Jul 15 15:21:03.314115 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:03.314029    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-73bd17-xv7t7_e496f5d4-e52a-45c5-a45d-7a376042317a/revoke-keys/0.log"
Jul 15 15:21:03.972856 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:03.972826    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-9f9f5c-vh82g_f633731b-176f-499b-9f58-509b1685ca6f/revoke-keys/0.log"
Jul 15 15:21:04.080444 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:04.080410    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-jxm5v_49671303-97c9-407c-8d23-b23ccd14ee40/postgres/0.log"
Jul 15 15:21:05.487046 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:05.487008    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bftj6_3f052848-97d5-4c8b-8aa5-9ee26e6ef241/manager/0.log"
Jul 15 15:21:05.596743 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:05.596702    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kz4qn_324342bf-8443-40ae-9605-5a1fd96d61ed/manager/0.log"
Jul 15 15:21:05.708467 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:05.708437    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-774sg_da64d1f6-668f-4e87-8db9-e9bbfe4cdecb/kuadrant-console-plugin/0.log"
Jul 15 15:21:05.835458 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:05.835358    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zb5m2_fbf38cc4-d784-4cb0-a2d0-a1157764b238/registry-server/0.log"
Jul 15 15:21:05.962348 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:05.962311    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-25xk6_6646d6cc-d718-4825-a40e-8fb7cc84b1e2/manager/0.log"
Jul 15 15:21:06.216152 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:06.216108    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xkgb6_440f6573-7ced-44c5-919d-fb7b50d79799/manager/0.log"
Jul 15 15:21:06.897819 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:06.897788    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c7c45d84-qxhpz_17469757-54d1-4005-b0a1-b0c9eed09c27/kube-auth-proxy/0.log"
Jul 15 15:21:07.143404 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:07.143359    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-k64zx_858ea7db-2970-4fc9-a576-7974b109c861/payload-pre-processing/0.log"
Jul 15 15:21:07.274195 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:07.274157    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-fvhdw_1436812e-8a9b-4cc4-9d06-ee008de22677/payload-processing/0.log"
Jul 15 15:21:07.743909 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:07.743879    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-z2g59_61bf7bcd-fd60-4446-8cf6-9bb06a5ddf34/main/0.log"
Jul 15 15:21:07.976920 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:07.976893    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6wsj2_6196eb00-9560-4d13-9dab-873290487630/main/0.log"
Jul 15 15:21:08.206188 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:08.206154    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-pgbdn_44b0d86c-8804-414e-9d46-0eedb63d011c/main/0.log"
Jul 15 15:21:14.269935 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:14.269903    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:14.357629 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:14.357589    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:17.297900 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:17.297840    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hr7xh_87271241-2e0f-48e4-a296-7842b26dd134/global-pull-secret-syncer/0.log"
Jul 15 15:21:17.358188 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:17.358151    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-425hb_4a27a6c6-2eee-49da-a95b-ce98f3d8418b/konnectivity-agent/0.log"
Jul 15 15:21:17.513761 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:17.513728    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-118.ec2.internal_c0da50a7d7df95402dc3e08da9587549/haproxy/0.log"
Jul 15 15:21:22.348088 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:22.348049    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bftj6_3f052848-97d5-4c8b-8aa5-9ee26e6ef241/manager/0.log"
Jul 15 15:21:22.373763 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:22.373725    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kz4qn_324342bf-8443-40ae-9605-5a1fd96d61ed/manager/0.log"
Jul 15 15:21:22.411004 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:22.410977    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-774sg_da64d1f6-668f-4e87-8db9-e9bbfe4cdecb/kuadrant-console-plugin/0.log"
Jul 15 15:21:22.477075 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:22.477044    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zb5m2_fbf38cc4-d784-4cb0-a2d0-a1157764b238/registry-server/0.log"
Jul 15 15:21:22.677428 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:22.677399    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-25xk6_6646d6cc-d718-4825-a40e-8fb7cc84b1e2/manager/0.log"
Jul 15 15:21:22.805103 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:22.805072    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xkgb6_440f6573-7ced-44c5-919d-fb7b50d79799/manager/0.log"
Jul 15 15:21:24.273151 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:24.273107    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_744371be-6c26-460c-b748-e89937c4dff2/alertmanager/0.log"
Jul 15 15:21:24.299125 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:24.299092    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_744371be-6c26-460c-b748-e89937c4dff2/config-reloader/0.log"
Jul 15 15:21:24.324713 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:24.324680    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_744371be-6c26-460c-b748-e89937c4dff2/kube-rbac-proxy-web/0.log"
Jul 15 15:21:24.353055 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:24.353018    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_744371be-6c26-460c-b748-e89937c4dff2/kube-rbac-proxy/0.log"
Jul 15 15:21:24.377511 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:24.377482    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_744371be-6c26-460c-b748-e89937c4dff2/kube-rbac-proxy-metric/0.log"
Jul 15 15:21:24.401673 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:24.401643    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_744371be-6c26-460c-b748-e89937c4dff2/prom-label-proxy/0.log"
Jul 15 15:21:24.429923 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:24.429897    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_744371be-6c26-460c-b748-e89937c4dff2/init-config-reloader/0.log"
Jul 15 15:21:24.764806 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:24.764774    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vd4j_1692b909-5265-40aa-9ad1-5d602ca0fa84/node-exporter/0.log"
Jul 15 15:21:24.794742 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:24.794708    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vd4j_1692b909-5265-40aa-9ad1-5d602ca0fa84/kube-rbac-proxy/0.log"
Jul 15 15:21:24.820989 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:24.820964    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8vd4j_1692b909-5265-40aa-9ad1-5d602ca0fa84/init-textfile/0.log"
Jul 15 15:21:25.245363 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:25.245328    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-x2z88_7ddd7751-c199-4a6b-975c-41d5a1732f47/prometheus-operator/0.log"
Jul 15 15:21:25.264914 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:25.264887    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-x2z88_7ddd7751-c199-4a6b-975c-41d5a1732f47/kube-rbac-proxy/0.log"
Jul 15 15:21:25.336207 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:25.336176    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54d96b664d-9hl8j_e8309a9a-a177-4907-bc77-243e9b8e0f8c/telemeter-client/0.log"
Jul 15 15:21:25.361498 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:25.361471    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54d96b664d-9hl8j_e8309a9a-a177-4907-bc77-243e9b8e0f8c/reload/0.log"
Jul 15 15:21:25.382596 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:25.382570    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54d96b664d-9hl8j_e8309a9a-a177-4907-bc77-243e9b8e0f8c/kube-rbac-proxy/0.log"
Jul 15 15:21:27.262265 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.262231    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"]
Jul 15 15:21:27.262799 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.262778    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f633731b-176f-499b-9f58-509b1685ca6f" containerName="revoke-keys"
Jul 15 15:21:27.262870 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.262802    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f633731b-176f-499b-9f58-509b1685ca6f" containerName="revoke-keys"
Jul 15 15:21:27.262959 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.262902    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f633731b-176f-499b-9f58-509b1685ca6f" containerName="revoke-keys"
Jul 15 15:21:27.266047 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.266011    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.268572 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.268546    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-96lvs\"/\"kube-root-ca.crt\""
Jul 15 15:21:27.268688 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.268595    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-96lvs\"/\"openshift-service-ca.crt\""
Jul 15 15:21:27.268741 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.268699    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-96lvs\"/\"default-dockercfg-vpnlm\""
Jul 15 15:21:27.275349 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.275321    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"]
Jul 15 15:21:27.308694 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.308656    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-proc\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.308694 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.308698    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-podres\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.308925 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.308722    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5pd6\" (UniqueName: \"kubernetes.io/projected/dd33d696-5e33-4475-8fa3-52bfbd525708-kube-api-access-l5pd6\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.308925 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.308808    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-lib-modules\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.308925 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.308846    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-sys\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.409516 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.409479    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-podres\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.409707 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.409529    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5pd6\" (UniqueName: \"kubernetes.io/projected/dd33d696-5e33-4475-8fa3-52bfbd525708-kube-api-access-l5pd6\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.409707 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.409571    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-lib-modules\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.409707 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.409600    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-sys\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.409707 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.409641    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-podres\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.409707 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.409699    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-proc\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.409904 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.409707    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-sys\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.409904 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.409733    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-lib-modules\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.409904 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.409764    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dd33d696-5e33-4475-8fa3-52bfbd525708-proc\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.418006 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.417980    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5pd6\" (UniqueName: \"kubernetes.io/projected/dd33d696-5e33-4475-8fa3-52bfbd525708-kube-api-access-l5pd6\") pod \"perf-node-gather-daemonset-5ks4w\" (UID: \"dd33d696-5e33-4475-8fa3-52bfbd525708\") " pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.577031 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.576947    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:27.710502 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:27.710472    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"]
Jul 15 15:21:27.712056 ip-10-0-140-118 kubenswrapper[2574]: W0715 15:21:27.712029    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddd33d696_5e33_4475_8fa3_52bfbd525708.slice/crio-bf8bd143588c7514931d97fef887316f8b3c6a95ba931565520ed6546c26197f WatchSource:0}: Error finding container bf8bd143588c7514931d97fef887316f8b3c6a95ba931565520ed6546c26197f: Status 404 returned error can't find the container with id bf8bd143588c7514931d97fef887316f8b3c6a95ba931565520ed6546c26197f
Jul 15 15:21:28.012385 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:28.012353    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-9bhfb_96ea9402-b03e-43f5-8921-dbc6bb916083/download-server/0.log"
Jul 15 15:21:28.118080 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:28.118040    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w" event={"ID":"dd33d696-5e33-4475-8fa3-52bfbd525708","Type":"ContainerStarted","Data":"234e3b856fbaf38cf0e02b1264fee6ced5e6bc550f6f105e528a0c548fb7dbf4"}
Jul 15 15:21:28.118280 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:28.118107    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w" event={"ID":"dd33d696-5e33-4475-8fa3-52bfbd525708","Type":"ContainerStarted","Data":"bf8bd143588c7514931d97fef887316f8b3c6a95ba931565520ed6546c26197f"}
Jul 15 15:21:28.118280 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:28.118157    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:28.137108 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:28.137056    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w" podStartSLOduration=1.137041545 podStartE2EDuration="1.137041545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:21:28.133873845 +0000 UTC m=+3048.026978211" watchObservedRunningTime="2026-07-15 15:21:28.137041545 +0000 UTC m=+3048.030145909"
Jul 15 15:21:29.661272 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:29.661219    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwh8s_ce4d862f-aeea-4d7e-a38e-bbd2ea25a233/dns/0.log"
Jul 15 15:21:29.685444 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:29.685410    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rwh8s_ce4d862f-aeea-4d7e-a38e-bbd2ea25a233/kube-rbac-proxy/0.log"
Jul 15 15:21:29.805750 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:29.805720    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m4b6r_d09b0399-d94d-4fab-be6c-912f4fd178d0/dns-node-resolver/0.log"
Jul 15 15:21:30.371721 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:30.371682    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9lhc5_55c22770-2f5a-40f0-b5cd-bcf852bf9109/node-ca/0.log"
Jul 15 15:21:31.497575 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:31.497546    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c7c45d84-qxhpz_17469757-54d1-4005-b0a1-b0c9eed09c27/kube-auth-proxy/0.log"
Jul 15 15:21:31.610053 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:31.609993    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-k64zx_858ea7db-2970-4fc9-a576-7974b109c861/payload-pre-processing/0.log"
Jul 15 15:21:31.648507 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:31.648463    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-fvhdw_1436812e-8a9b-4cc4-9d06-ee008de22677/payload-processing/0.log"
Jul 15 15:21:32.416355 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:32.416277    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z9lt8_7c4f431a-01f0-4d42-a5e9-956bd037771e/serve-healthcheck-canary/0.log"
Jul 15 15:21:33.089367 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:33.089337    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrdwx_b9a30e2b-0077-467f-bfd9-0f575080f050/kube-rbac-proxy/0.log"
Jul 15 15:21:33.111910 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:33.111881    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrdwx_b9a30e2b-0077-467f-bfd9-0f575080f050/exporter/0.log"
Jul 15 15:21:33.135664 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:33.135620    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qrdwx_b9a30e2b-0077-467f-bfd9-0f575080f050/extractor/0.log"
Jul 15 15:21:34.133678 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:34.133653    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-96lvs/perf-node-gather-daemonset-5ks4w"
Jul 15 15:21:35.223545 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:35.223516    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jwscq_8b1d83ae-11b0-4164-886c-0f11faab6c7b/manager/0.log"
Jul 15 15:21:35.448462 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:35.448427    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l92vm_00200266-83dc-421a-8a60-52c89a10f6ea/manager/0.log"
Jul 15 15:21:35.611163 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:35.611025    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5498759d79-brr9s_69c4ac2b-2330-4260-83c5-b51e1a74ec9a/manager/0.log"
Jul 15 15:21:35.637056 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:35.637030    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-78lwg_e75bb13e-4efb-4351-b86e-c6352787b709/server/0.log"
Jul 15 15:21:35.747123 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:35.747099    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lsmqk_fe634588-29b9-4afe-a83d-33ed0982c29f/manager/0.log"
Jul 15 15:21:35.916978 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:35.916944    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-g4wcv_9aec7704-c886-45ea-b7d9-ad56da099b7f/manager/0.log"
Jul 15 15:21:35.936573 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:35.936545    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846b6d9d56-g4wcv_9aec7704-c886-45ea-b7d9-ad56da099b7f/copy-manifests/0.log"
Jul 15 15:21:37.509526 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:37.509432    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-q62n5_aafc4239-3b25-4da8-989a-3b8c1afd3012/openshift-lws-operator/0.log"
Jul 15 15:21:37.663151 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:37.663113    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c7c45d84-qxhpz_17469757-54d1-4005-b0a1-b0c9eed09c27/kube-auth-proxy/0.log"
Jul 15 15:21:37.737423 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:37.737386    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-k64zx_858ea7db-2970-4fc9-a576-7974b109c861/payload-pre-processing/0.log"
Jul 15 15:21:37.766611 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:37.766493    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-fvhdw_1436812e-8a9b-4cc4-9d06-ee008de22677/payload-processing/0.log"
Jul 15 15:21:39.142022 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:39.141954    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-86c7c45d84-qxhpz_17469757-54d1-4005-b0a1-b0c9eed09c27/kube-auth-proxy/0.log"
Jul 15 15:21:39.217934 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:39.217900    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-k64zx_858ea7db-2970-4fc9-a576-7974b109c861/payload-pre-processing/0.log"
Jul 15 15:21:39.246599 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:39.246555    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-fvhdw_1436812e-8a9b-4cc4-9d06-ee008de22677/payload-processing/0.log"
Jul 15 15:21:40.957282 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:40.957230    2574 scope.go:117] "RemoveContainer" containerID="59c6214ee739761b8b5328fb1ee76e9c5fcc3b7f52ac9db0afb3fcb4bf78b606"
Jul 15 15:21:40.967321 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:40.967296    2574 scope.go:117] "RemoveContainer" containerID="f928b53b31322d76799afc6de2d2cee7995d93fa13e902da80634f5a8c3baa2f"
Jul 15 15:21:43.947945 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:43.947904    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcgjm_a4916d51-34b1-46b9-bd0b-fa0eeda5b548/kube-multus-additional-cni-plugins/0.log"
Jul 15 15:21:43.972055 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:43.972026    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcgjm_a4916d51-34b1-46b9-bd0b-fa0eeda5b548/egress-router-binary-copy/0.log"
Jul 15 15:21:43.994213 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:43.994189    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcgjm_a4916d51-34b1-46b9-bd0b-fa0eeda5b548/cni-plugins/0.log"
Jul 15 15:21:44.018812 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:44.018784    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcgjm_a4916d51-34b1-46b9-bd0b-fa0eeda5b548/bond-cni-plugin/0.log"
Jul 15 15:21:44.042000 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:44.041968    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcgjm_a4916d51-34b1-46b9-bd0b-fa0eeda5b548/routeoverride-cni/0.log"
Jul 15 15:21:44.065321 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:44.065274    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcgjm_a4916d51-34b1-46b9-bd0b-fa0eeda5b548/whereabouts-cni-bincopy/0.log"
Jul 15 15:21:44.087324 ip-10-0-140-118 kubenswrapper[2574]: I0715 15:21:44.087296    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gcgjm_a4916d51-34b1-46b9-bd0b-fa0eeda5b548/whereabouts-cni/0.log"